Started by upstream project "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5196 originally caused by: Started by upstream project "master-osmo-pcu" build number 5364 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6695 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6690 originally caused by: Started by upstream project "master-libgtpnl" build number 1814 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu" build number 5157 originally caused by: Started by upstream project "master-osmo-pcu" build number 5364 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3913 originally caused by: Started by upstream project "master-osmo-pcu" build number 5364 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30104 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37280 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30105 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37281 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6690 originally caused by: Started by upstream project "master-libgtpnl" build number 1814 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8965 originally caused by: Started by upstream project "master-osmo-mgw" build number 9197 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17689 originally caused by: Started by upstream project "master-osmo-bsc" build number 20153 originally caused by: Started by upstream project "master-osmo-mgw" build number 9197 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29318 originally caused by: Started by upstream project "master-osmo-msc" build number 34286 originally caused by: Started by upstream project "master-osmo-mgw" build number 9197 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17689 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7515 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6695 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8719 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8965 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2998 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29318 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5157 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30105 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4686 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12995 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9261 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4714 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8046 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5196 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5542 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3913 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins12972817141342917081.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-14 09:52:26 + trial_dir_prefix=trial- + rm -rf trial-2402 trial-2402-bin.tgz trial-2402-run.tgz + trial_dir=trial-2403 + mkdir -p trial-2403 + mv open5gs.build-8.tgz osmo-bsc.build-17689.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6695.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2998.tgz osmo-mgw.build-8965.tgz osmo-msc.build-29318.tgz osmo-nitb.build-12995.tgz osmo-pcu-oc2g.build-3913.tgz osmo-pcu-sysmo.build-5196.tgz osmo-pcu.build-5157.tgz osmo-sgsn.build-30105.tgz osmo-stp.build-9261.tgz osmo-trx.build-4686.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz trial-2403 + cat open5gs.build-8.md5 osmo-bsc.build-17689.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6695.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2998.md5 osmo-mgw.build-8965.md5 osmo-msc.build-29318.md5 osmo-nitb.build-12995.md5 osmo-pcu-oc2g.build-3913.md5 osmo-pcu-sysmo.build-5196.md5 osmo-pcu.build-5157.md5 osmo-sgsn.build-30105.md5 osmo-stp.build-9261.md5 osmo-trx.build-4686.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17689.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6695.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2998.md5 osmo-mgw.build-8965.md5 osmo-msc.build-29318.md5 osmo-nitb.build-12995.md5 osmo-pcu-oc2g.build-3913.md5 osmo-pcu-sysmo.build-5196.md5 osmo-pcu.build-5157.md5 osmo-sgsn.build-30105.md5 osmo-stp.build-9261.md5 osmo-trx.build-4686.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2403 combinations: None trial: 'trial-2403' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2403 -------------------------------------------------------------------------------------------- 09:52:37.191700 tst trial-2403: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/log --------------------------------------------------------------------- trial-2403 nitb_sms:sysmo --------------------------------------------------------------------- 09:54:45.741254 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:54:45.744748 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 09:54:45.765462 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 09:54:45.772086 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 09:54:45.839295 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 09:54:45.866148 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 09:54:45.874024 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 09:54:46.403013 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 09:54:46.409945 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 09:54:46.423997 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 09:54:46.885645 tst mo_mt_sms.py: using LAC 40118 09:54:47.184019 tst mo_mt_sms.py: using RAC 83 09:54:47.308762 tst mo_mt_sms.py: using CellId 40118 09:54:47.435464 tst mo_mt_sms.py: using BVCI 40119 09:54:47.550021 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 09:54:47.729717 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 09:54:47.847066 tst mo_mt_sms.py:9: start nitb and bts... 09:54:48.047649 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:54:50.288391 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3371): Launched 09:54:50.590218 run osmo-nitb_10.42.42.2(pid=3372): Launched 09:54:50.755377 run osmo-nitb_10.42.42.2(pid=3372): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3372)] 09:54:50.878915 run osmo-nitb_10.42.42.2(pid=3372): stdout: | (launched: 2022-12-14_09:54:50.533834) 09:54:51.004652 run osmo-nitb_10.42.42.2(pid=3372): stderr: | (launched: 2022-12-14_09:54:50.578330) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:54:51.129789 run osmo-nitb_10.42.42.2(pid=3372): stdout: | (launched: 2022-12-14_09:54:50.533834) 09:54:51.249341 run osmo-nitb_10.42.42.2(pid=3372): stderr: | (launched: 2022-12-14_09:54:50.578330) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:54:51.391828 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3372): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3372) [trial-2403↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3372)] [trial-2403↪nitb_sms:sysmo↪mo_mt_sms.py:11] 09:54:51.400168 tst mo_mt_sms.py:11: Test FAILED (5.0 sec) 09:54:51.406779 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3371): Terminating (SIGTERM) 09:54:51.616414 --- ParallelTerminationStrategy: PID 3371 died... 09:54:51.637146 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3371): Terminated: ok {rc=0} 09:54:51.722501 bus /sierra_3: Setting Powered False 09:54:52.823702 bus /sierra_3: Setting Powered False 09:54:53.944115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 sms:sysmo --------------------------------------------------------------------- 09:54:55.132262 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:54:55.137280 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 09:54:55.158715 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 09:54:55.186003 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 09:54:55.238450 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 09:54:55.259555 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 09:54:55.286637 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 09:54:55.832016 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 sms:sysmo mo_mt_sms.py ---------------------------------------------- 09:54:55.837294 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:54:55.847942 tst sms:sysmo: Using 1 x bts (candidates: 1) 09:54:55.881804 tst mo_mt_sms.py: using LAC 40119 09:54:56.003046 tst mo_mt_sms.py: using RAC 84 09:54:56.130048 tst mo_mt_sms.py: using CellId 40119 09:54:56.256515 tst mo_mt_sms.py: using BVCI 40120 09:54:56.371868 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:54:56.383297 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:54:56.394320 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:54:56.405225 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:54:56.415989 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:54:56.426962 tst sms:sysmo: Using 1 x modem (candidates: 2) 09:54:56.544453 tst sms:sysmo: Using 1 x modem (candidates: 2) 09:54:56.665460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:58.429725 run create_hlr_db(pid=3376): Launched 09:54:58.559947 bus /sierra_2: Setting Powered False 09:54:59.623136 run create_hlr_db(pid=3376): Terminated: ok {rc=0} 09:55:00.058480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3378): Launched 09:55:00.361593 run osmo-hlr_10.42.42.2(pid=3379): Launched 09:55:00.478362 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:03.114679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3391): Launched 09:55:03.419427 run osmo-stp_10.42.42.5(pid=3392): Launched 09:55:03.535756 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:08.774713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3394): Launched 09:55:09.078145 run osmo-msc_10.42.42.6(pid=3395): Launched 09:55:09.247374 run osmo-stp_10.42.42.5(pid=3392): ERR: Terminated: ERROR {rc=1} [trial-2403↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3392)] 09:55:09.375524 run osmo-stp_10.42.42.5(pid=3392): stdout: | (launched: 2022-12-14_09:55:03.362743) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:09.502893 run osmo-stp_10.42.42.5(pid=3392): stderr: | 20221214095503534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095503534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095503534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095503535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095503535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095503535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095503535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:09.628031 run osmo-stp_10.42.42.5(pid=3392): stdout: | (launched: 2022-12-14_09:55:03.362743) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:09.747885 run osmo-stp_10.42.42.5(pid=3392): stderr: | 20221214095503534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095503534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095503534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095503535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095503535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095503535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095503535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:09.890923 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3392): Process ended prematurely: osmo-stp_10.42.42.5(pid=3392) [trial-2403↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3392)] [trial-2403↪sms:sysmo↪mo_mt_sms.py:16] 09:55:09.899558 tst mo_mt_sms.py:16: Test FAILED (14.1 sec) 09:55:09.925812 run osmo-hlr_10.42.42.2(pid=3379): ERR: Terminated: ERROR {rc=237} [trial-2403↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3379)] 09:55:09.974628 run osmo-hlr_10.42.42.2(pid=3379): stdout: | (launched: 2022-12-14_09:55:00.304594) 09:55:10.025116 run osmo-hlr_10.42.42.2(pid=3379): stderr: | 20221214095500485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095500485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095500485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095500485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095500485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095500486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095500498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095500506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095500507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095500507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:10.094881 run osmo-msc_10.42.42.6(pid=3395): ERR: Terminated: ERROR {rc=2} [trial-2403↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3395)] 09:55:10.143082 run osmo-msc_10.42.42.6(pid=3395): stdout: | (launched: 2022-12-14_09:55:09.021268) 09:55:10.193573 run osmo-msc_10.42.42.6(pid=3395): stderr: | 20221214095509293 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095509294 DLGLOBAL DEBUG validating counter group 0x7fbe8a49ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095509294 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095509294 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095509294 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095509294 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095509297 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095509298 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095509298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095509298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:10.244594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3378): Terminating (SIGTERM) 09:55:10.285430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3391): Terminating (SIGTERM) 09:55:10.326032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3394): Terminating (SIGTERM) 09:55:10.366558 --- ParallelTerminationStrategy: PID 3378 died... 09:55:10.386284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3378): Terminated: ok {rc=0} 09:55:10.431067 --- ParallelTerminationStrategy: PID 3391 died... 09:55:10.450305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3391): Terminated: ok {rc=0} 09:55:10.494926 --- ParallelTerminationStrategy: PID 3394 died... 09:55:10.520388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3394): Terminated: ok {rc=0} 09:55:10.608220 bus /sierra_3: Setting Powered False 09:55:11.710119 bus /sierra_3: Setting Powered False 09:55:12.828027 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_ussd:sysmo --------------------------------------------------------------------- 09:55:14.056749 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:14.061370 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 09:55:14.083557 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 09:55:14.091376 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 09:55:14.129087 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 09:55:14.152326 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 09:55:14.159929 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 09:55:14.678645 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2403 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 09:55:14.685373 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 09:55:14.696920 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 09:55:14.733549 tst assert_extension.py: using LAC 40120 09:55:14.859191 tst assert_extension.py: using RAC 85 09:55:14.980003 tst assert_extension.py: using CellId 40120 09:55:15.106757 tst assert_extension.py: using BVCI 40121 09:55:15.225067 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 09:55:15.341316 tst assert_extension.py:10: start nitb and bts... 09:55:15.543195 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:55:16.169522 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3753): Launched 09:55:16.517706 run osmo-nitb_10.42.42.2(pid=3754): Launched 09:55:16.701233 run osmo-nitb_10.42.42.2(pid=3754): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3754)] 09:55:16.840622 run osmo-nitb_10.42.42.2(pid=3754): stdout: | (launched: 2022-12-14_09:55:16.449341) 09:55:16.982231 run osmo-nitb_10.42.42.2(pid=3754): stderr: | (launched: 2022-12-14_09:55:16.498152) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:55:17.124611 run osmo-nitb_10.42.42.2(pid=3754): stdout: | (launched: 2022-12-14_09:55:16.449341) 09:55:17.260938 run osmo-nitb_10.42.42.2(pid=3754): stderr: | (launched: 2022-12-14_09:55:16.498152) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3754): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3754) [trial-2403↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3754)] 09:55:17.646182 tst osmo-nitb_10.42.42.2(pid=3754): stdout: | (launched: 2022-12-14_09:55:16.449341) 09:55:17.776852 tst osmo-nitb_10.42.42.2(pid=3754): stderr: | (launched: 2022-12-14_09:55:16.498152) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:55:17.930816 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3754): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3754) [trial-2403↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3754)] [trial-2403↪nitb_ussd:sysmo↪assert_extension.py:12] 09:55:17.939782 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:55:17.947006 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3753): Terminating (SIGTERM) 09:55:18.158090 --- ParallelTerminationStrategy: PID 3753 died... 09:55:18.180188 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3753): Terminated: ok {rc=0} 09:55:18.270684 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 ussd:sysmo --------------------------------------------------------------------- 09:55:19.564436 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:19.568689 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 09:55:19.590240 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 09:55:19.617961 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 09:55:19.652286 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 09:55:19.673835 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 09:55:19.701546 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 09:55:20.231406 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2403 ussd:sysmo assert_extension.py ---------------------------------------------- 09:55:20.237049 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:55:20.248222 tst ussd:sysmo: Using 1 x bts (candidates: 1) 09:55:20.282564 tst assert_extension.py: using LAC 40121 09:55:20.401044 tst assert_extension.py: using RAC 86 09:55:20.526689 tst assert_extension.py: using CellId 40121 09:55:20.653532 tst assert_extension.py: using BVCI 40122 09:55:20.771908 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:55:20.783100 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:55:20.794057 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:55:20.805212 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:55:20.816073 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:55:20.826924 tst ussd:sysmo: Using 1 x modem (candidates: 1) 09:55:20.945760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:21.447372 run create_hlr_db(pid=3759): Launched 09:55:21.577540 bus /sierra_2: Setting Powered False 09:55:22.641621 run create_hlr_db(pid=3759): Terminated: ok {rc=0} 09:55:23.077225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3761): Launched 09:55:23.381421 run osmo-hlr_10.42.42.2(pid=3762): Launched 09:55:23.499834 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:24.163812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3846): Launched 09:55:24.484027 run osmo-stp_10.42.42.5(pid=3881): Launched 09:55:24.730959 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:25.410336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3942): Launched 09:55:25.729704 run osmo-msc_10.42.42.6(pid=3943): Launched 09:55:26.073626 run osmo-stp_10.42.42.5(pid=3881): ERR: Terminated: ERROR {rc=1} [trial-2403↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3881)] 09:55:26.343222 run osmo-stp_10.42.42.5(pid=3881): stdout: | (launched: 2022-12-14_09:55:24.426037) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:26.613981 run osmo-stp_10.42.42.5(pid=3881): stderr: | 20221214095524770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095524770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095524770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095524771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095524771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095524771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095524771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:26.775793 run osmo-stp_10.42.42.5(pid=3881): stdout: | (launched: 2022-12-14_09:55:24.426037) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:26.899339 run osmo-stp_10.42.42.5(pid=3881): stderr: | 20221214095524770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095524770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095524770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095524771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095524771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095524771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095524771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:27.046961 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3881): Process ended prematurely: osmo-stp_10.42.42.5(pid=3881) [trial-2403↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3881)] [trial-2403↪ussd:sysmo↪assert_extension.py:17] 09:55:27.056359 tst assert_extension.py:17: Test FAILED (6.8 sec) 09:55:27.083771 run osmo-hlr_10.42.42.2(pid=3762): ERR: Terminated: ERROR {rc=237} [trial-2403↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3762)] 09:55:27.135783 run osmo-hlr_10.42.42.2(pid=3762): stdout: | (launched: 2022-12-14_09:55:23.324416) 09:55:27.188188 run osmo-hlr_10.42.42.2(pid=3762): stderr: | 20221214095523555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095523555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095523555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095523555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095523555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095523555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095523647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095523656 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095523656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095523656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:27.262327 run osmo-msc_10.42.42.6(pid=3943): ERR: Terminated: ERROR {rc=2} [trial-2403↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3943)] 09:55:27.312253 run osmo-msc_10.42.42.6(pid=3943): stdout: | (launched: 2022-12-14_09:55:25.672078) 09:55:27.364621 run osmo-msc_10.42.42.6(pid=3943): stderr: | 20221214095526253 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095526253 DLGLOBAL DEBUG validating counter group 0x7fea6096ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095526253 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095526253 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095526254 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095526254 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095526255 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095526256 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095526256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095526256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:27.417594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3761): Terminating (SIGTERM) 09:55:27.460848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3846): Terminating (SIGTERM) 09:55:27.506413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3942): Terminating (SIGTERM) 09:55:27.551873 --- ParallelTerminationStrategy: PID 3761 died... 09:55:27.573513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3761): Terminated: ok {rc=0} 09:55:27.622150 --- ParallelTerminationStrategy: PID 3846 died... 09:55:27.643213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3846): Terminated: ok {rc=0} 09:55:27.690477 --- ParallelTerminationStrategy: PID 3942 died... 09:55:27.711378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3942): Terminated: ok {rc=0} 09:55:27.800884 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:55:28.997733 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:29.005239 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:55:29.028319 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:55:29.060322 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:55:29.114836 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:55:29.136788 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:55:29.165616 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:55:29.712392 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:55:29.767719 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:55:29.779185 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:55:29.837864 tst mo_mt_call.py: using LAC 40122 09:55:29.967468 tst mo_mt_call.py: using RAC 87 09:55:30.097747 tst mo_mt_call.py: using CellId 40122 09:55:30.227532 tst mo_mt_call.py: using BVCI 40123 09:55:30.347834 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:55:30.359481 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:55:30.370847 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:55:30.382270 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:55:30.393559 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:55:30.405039 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:55:30.523263 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:55:30.643819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:31.174617 run create_hlr_db(pid=3949): Launched 09:55:31.337573 bus /sierra_2: Setting Powered False 09:55:32.402622 run create_hlr_db(pid=3949): Terminated: ok {rc=0} 09:55:32.862770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3951): Launched 09:55:33.192474 run osmo-hlr_10.42.42.2(pid=3952): Launched 09:55:33.318962 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:33.891684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3954): Launched 09:55:34.221324 run osmo-stp_10.42.42.5(pid=3955): Launched 09:55:34.347239 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:34.941973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3957): Launched 09:55:35.272280 run osmo-msc_10.42.42.6(pid=3958): Launched 09:55:35.457446 run osmo-stp_10.42.42.5(pid=3955): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3955)] 09:55:35.595641 run osmo-stp_10.42.42.5(pid=3955): stdout: | (launched: 2022-12-14_09:55:34.159778) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:35.734703 run osmo-stp_10.42.42.5(pid=3955): stderr: | 20221214095534356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095534356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095534356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095534356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095534357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095534357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095534357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:35.872378 run osmo-stp_10.42.42.5(pid=3955): stdout: | (launched: 2022-12-14_09:55:34.159778) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:36.002927 run osmo-stp_10.42.42.5(pid=3955): stderr: | 20221214095534356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095534356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095534356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095534356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095534357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095534357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095534357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:36.158987 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3955): Process ended prematurely: osmo-stp_10.42.42.5(pid=3955) [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3955)] [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:55:36.168560 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:55:36.196312 run osmo-hlr_10.42.42.2(pid=3952): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3952)] 09:55:36.247070 run osmo-hlr_10.42.42.2(pid=3952): stdout: | (launched: 2022-12-14_09:55:33.131258) 09:55:36.299532 run osmo-hlr_10.42.42.2(pid=3952): stderr: | 20221214095533331 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095533331 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095533331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095533331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095533331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095533331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095533344 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095533352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095533352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095533353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:36.372425 run osmo-msc_10.42.42.6(pid=3958): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3958)] 09:55:36.422894 run osmo-msc_10.42.42.6(pid=3958): stdout: | (launched: 2022-12-14_09:55:35.211239) 09:55:36.475100 run osmo-msc_10.42.42.6(pid=3958): stderr: | 20221214095535539 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095535539 DLGLOBAL DEBUG validating counter group 0x7ff5c889ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095535539 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095535539 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095535539 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095535539 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095535541 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095535542 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095535542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095535542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:36.527785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3951): Terminating (SIGTERM) 09:55:36.569956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3954): Terminating (SIGTERM) 09:55:36.612167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3957): Terminating (SIGTERM) 09:55:36.654324 --- ParallelTerminationStrategy: PID 3951 died... 09:55:36.674582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3951): Terminated: ok {rc=0} 09:55:36.721351 --- ParallelTerminationStrategy: PID 3954 died... 09:55:36.741227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3954): Terminated: ok {rc=0} 09:55:36.787502 --- ParallelTerminationStrategy: PID 3957 died... 09:55:36.806996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3957): Terminated: ok {rc=0} 09:55:36.894393 bus /sierra_3: Setting Powered False 09:55:37.996050 bus /sierra_3: Setting Powered False 09:55:39.112877 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:55:40.264095 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:55:40.276486 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:55:40.341140 tst mo_mt_call_osmux.py: using LAC 40123 09:55:40.469413 tst mo_mt_call_osmux.py: using RAC 88 09:55:40.596636 tst mo_mt_call_osmux.py: using CellId 40123 09:55:40.724087 tst mo_mt_call_osmux.py: using BVCI 40124 09:55:40.845564 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:55:40.857587 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:55:40.869086 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:55:40.880477 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:55:40.891972 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:55:40.903522 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:55:41.024338 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:55:41.143996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:41.625535 run create_hlr_db(pid=3960): Launched 09:55:41.743617 bus /sierra_2: Setting Powered False 09:55:42.804196 run create_hlr_db(pid=3960): Terminated: ok {rc=0} 09:55:43.235893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3962): Launched 09:55:43.546584 run osmo-hlr_10.42.42.2(pid=3963): Launched 09:55:43.663917 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:44.208533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3965): Launched 09:55:44.519644 run osmo-stp_10.42.42.5(pid=3966): Launched 09:55:44.640170 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:45.200363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3968): Launched 09:55:45.514141 run osmo-msc_10.42.42.6(pid=3969): Launched 09:55:45.688701 run osmo-stp_10.42.42.5(pid=3966): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3966)] 09:55:45.819470 run osmo-stp_10.42.42.5(pid=3966): stdout: | (launched: 2022-12-14_09:55:44.461916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:46.016735 run osmo-stp_10.42.42.5(pid=3966): stderr: | 20221214095544636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095544636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095544637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095544637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095544638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095544638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095544638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:46.161510 run osmo-stp_10.42.42.5(pid=3966): stdout: | (launched: 2022-12-14_09:55:44.461916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:46.288097 run osmo-stp_10.42.42.5(pid=3966): stderr: | 20221214095544636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095544636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095544637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095544637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095544638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095544638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095544638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:46.438815 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3966): Process ended prematurely: osmo-stp_10.42.42.5(pid=3966) [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3966)] [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:55:46.448766 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:55:46.476439 run osmo-hlr_10.42.42.2(pid=3963): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3963)] 09:55:46.531283 run osmo-hlr_10.42.42.2(pid=3963): stdout: | (launched: 2022-12-14_09:55:43.489067) 09:55:46.585665 run osmo-hlr_10.42.42.2(pid=3963): stderr: | 20221214095543666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095543667 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095543667 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095543667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095543667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095543667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095543682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095543691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095543691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095543691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:46.661813 run osmo-msc_10.42.42.6(pid=3969): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3969)] 09:55:46.714570 run osmo-msc_10.42.42.6(pid=3969): stdout: | (launched: 2022-12-14_09:55:45.455675) 09:55:46.768790 run osmo-msc_10.42.42.6(pid=3969): stderr: | 20221214095545732 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095545732 DLGLOBAL DEBUG validating counter group 0x7f10705c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095545732 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095545732 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095545732 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095545732 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095545734 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095545734 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095545735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095545735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:46.824268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3962): Terminating (SIGTERM) 09:55:46.869346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3965): Terminating (SIGTERM) 09:55:46.915148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3968): Terminating (SIGTERM) 09:55:46.960935 --- ParallelTerminationStrategy: PID 3962 died... 09:55:46.981741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3962): Terminated: ok {rc=0} 09:55:47.033355 --- ParallelTerminationStrategy: PID 3965 died... 09:55:47.055008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3965): Terminated: ok {rc=0} 09:55:47.102614 --- ParallelTerminationStrategy: PID 3968 died... 09:55:47.124169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3968): Terminated: ok {rc=0} 09:55:47.214493 bus /sierra_3: Setting Powered False 09:55:48.315314 bus /sierra_3: Setting Powered False 09:55:49.433876 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:55:50.676063 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:50.683090 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:55:50.704929 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:55:50.732712 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:55:50.785616 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:55:50.807093 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:55:50.834552 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:55:51.390790 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:55:51.444235 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:55:51.455817 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:55:51.513532 tst mo_mt_call.py: using LAC 40124 09:55:51.647411 tst mo_mt_call.py: using RAC 89 09:55:51.777669 tst mo_mt_call.py: using CellId 40124 09:55:51.904555 tst mo_mt_call.py: using BVCI 40125 09:55:52.024636 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:55:52.035833 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:55:52.046797 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:55:52.058949 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:55:52.070222 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:55:52.081471 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:55:52.203055 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:55:52.325532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:52.836243 run create_hlr_db(pid=3976): Launched 09:55:52.969386 bus /sierra_2: Setting Powered False 09:55:54.030906 run create_hlr_db(pid=3976): Terminated: ok {rc=0} 09:55:54.463956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3978): Launched 09:55:54.774954 run osmo-hlr_10.42.42.2(pid=3979): Launched 09:55:54.893504 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:55.465601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3981): Launched 09:55:55.798603 run osmo-stp_10.42.42.5(pid=3982): Launched 09:55:55.922908 run osmo-msc_10.42.42.6: Starting osmo-msc 09:55:56.516593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3984): Launched 09:55:56.848605 run osmo-msc_10.42.42.6(pid=3985): Launched 09:55:57.031618 run osmo-stp_10.42.42.5(pid=3982): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3982)] 09:55:57.169668 run osmo-stp_10.42.42.5(pid=3982): stdout: | (launched: 2022-12-14_09:55:55.736834) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:57.307799 run osmo-stp_10.42.42.5(pid=3982): stderr: | 20221214095555933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095555933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095555934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095555934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095555934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095555935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095555935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:57.446091 run osmo-stp_10.42.42.5(pid=3982): stdout: | (launched: 2022-12-14_09:55:55.736834) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:57.576894 run osmo-stp_10.42.42.5(pid=3982): stderr: | 20221214095555933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095555933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095555934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095555934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095555934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095555935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095555935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:57.733297 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3982): Process ended prematurely: osmo-stp_10.42.42.5(pid=3982) [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3982)] [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:55:57.742943 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:55:57.771095 run osmo-hlr_10.42.42.2(pid=3979): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3979)] 09:55:57.821597 run osmo-hlr_10.42.42.2(pid=3979): stdout: | (launched: 2022-12-14_09:55:54.717408) 09:55:57.873558 run osmo-hlr_10.42.42.2(pid=3979): stderr: | 20221214095554897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095554897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095554897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095554898 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095554898 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095554898 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095554912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095554922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095554922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095554923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:57.945962 run osmo-msc_10.42.42.6(pid=3985): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3985)] 09:55:57.996310 run osmo-msc_10.42.42.6(pid=3985): stdout: | (launched: 2022-12-14_09:55:56.787364) 09:55:58.048336 run osmo-msc_10.42.42.6(pid=3985): stderr: | 20221214095557114 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095557114 DLGLOBAL DEBUG validating counter group 0x7fe2e2f5fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095557114 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095557115 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095557115 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095557115 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095557117 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095557117 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095557117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095557117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:55:58.100697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3978): Terminating (SIGTERM) 09:55:58.142432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3981): Terminating (SIGTERM) 09:55:58.184397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3984): Terminating (SIGTERM) 09:55:58.226533 --- ParallelTerminationStrategy: PID 3978 died... 09:55:58.246614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3978): Terminated: ok {rc=0} 09:55:58.292811 --- ParallelTerminationStrategy: PID 3981 died... 09:55:58.312343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3981): Terminated: ok {rc=0} 09:55:58.358375 --- ParallelTerminationStrategy: PID 3984 died... 09:55:58.378057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3984): Terminated: ok {rc=0} 09:55:58.466432 bus /sierra_3: Setting Powered False 09:55:59.562380 bus /sierra_3: Setting Powered False 09:56:00.677249 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:56:01.830209 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:56:01.843424 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:56:01.901881 tst mo_mt_call_osmux.py: using LAC 40125 09:56:02.061772 tst mo_mt_call_osmux.py: using RAC 90 09:56:02.211604 tst mo_mt_call_osmux.py: using CellId 40125 09:56:02.342206 tst mo_mt_call_osmux.py: using BVCI 40126 09:56:02.463291 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:56:02.474821 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:56:02.486277 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:56:02.497654 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:56:02.508854 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:56:02.520264 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:56:02.643494 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:56:02.762592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:03.243724 run create_hlr_db(pid=3987): Launched 09:56:03.363947 bus /sierra_2: Setting Powered False 09:56:04.424757 run create_hlr_db(pid=3987): Terminated: ok {rc=0} 09:56:04.877802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3989): Launched 09:56:05.211010 run osmo-hlr_10.42.42.2(pid=3990): Launched 09:56:05.338395 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:05.907851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3992): Launched 09:56:06.238117 run osmo-stp_10.42.42.5(pid=3993): Launched 09:56:06.363434 run osmo-msc_10.42.42.6: Starting osmo-msc 09:56:06.962220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3995): Launched 09:56:07.294515 run osmo-msc_10.42.42.6(pid=3996): Launched 09:56:07.479612 run osmo-stp_10.42.42.5(pid=3993): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3993)] 09:56:07.618696 run osmo-stp_10.42.42.5(pid=3993): stdout: | (launched: 2022-12-14_09:56:06.176450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:07.758820 run osmo-stp_10.42.42.5(pid=3993): stderr: | 20221214095606371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095606371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095606371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095606372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095606374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095606374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095606374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:07.897052 run osmo-stp_10.42.42.5(pid=3993): stdout: | (launched: 2022-12-14_09:56:06.176450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:08.027180 run osmo-stp_10.42.42.5(pid=3993): stderr: | 20221214095606371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095606371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095606371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095606372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095606374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095606374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095606374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:08.183868 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3993): Process ended prematurely: osmo-stp_10.42.42.5(pid=3993) [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3993)] [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:56:08.193494 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:56:08.221403 run osmo-hlr_10.42.42.2(pid=3990): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3990)] 09:56:08.272115 run osmo-hlr_10.42.42.2(pid=3990): stdout: | (launched: 2022-12-14_09:56:05.149144) 09:56:08.324675 run osmo-hlr_10.42.42.2(pid=3990): stderr: | 20221214095605349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095605349 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095605349 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095605349 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095605350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095605350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095605363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095605372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095605372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095605372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:08.398079 run osmo-msc_10.42.42.6(pid=3996): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3996)] 09:56:08.448888 run osmo-msc_10.42.42.6(pid=3996): stdout: | (launched: 2022-12-14_09:56:07.232864) 09:56:08.501659 run osmo-msc_10.42.42.6(pid=3996): stderr: | 20221214095607557 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095607557 DLGLOBAL DEBUG validating counter group 0x7f1671817c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095607557 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095607557 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095607558 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095607558 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095607559 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095607560 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095607560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095607560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:56:08.554311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3989): Terminating (SIGTERM) 09:56:08.596636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3992): Terminating (SIGTERM) 09:56:08.639411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3995): Terminating (SIGTERM) 09:56:08.681712 --- ParallelTerminationStrategy: PID 3989 died... 09:56:08.702073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3989): Terminated: ok {rc=0} 09:56:08.748530 --- ParallelTerminationStrategy: PID 3992 died... 09:56:08.768314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3992): Terminated: ok {rc=0} 09:56:08.814539 --- ParallelTerminationStrategy: PID 3995 died... 09:56:08.834146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3995): Terminated: ok {rc=0} 09:56:08.921954 bus /sierra_3: Setting Powered False 09:56:10.021383 bus /sierra_3: Setting Powered False 09:56:11.138041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:56:12.376348 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:56:12.383313 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:56:12.404720 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:56:12.432282 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:56:12.485461 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:56:12.506883 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:56:12.534215 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:56:13.085418 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:56:13.138932 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:56:13.150635 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:56:13.209372 tst mo_mt_call.py: using LAC 40126 09:56:13.342447 tst mo_mt_call.py: using RAC 91 09:56:13.471217 tst mo_mt_call.py: using CellId 40126 09:56:13.598363 tst mo_mt_call.py: using BVCI 40127 09:56:13.718852 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:56:13.730571 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:56:13.742071 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:56:13.753411 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:56:13.765404 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:56:13.777383 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:56:13.896626 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:56:14.016788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:14.531872 run create_hlr_db(pid=4001): Launched 09:56:14.667234 bus /sierra_2: Setting Powered False 09:56:15.732121 run create_hlr_db(pid=4001): Terminated: ok {rc=0} 09:56:16.221991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4003): Launched 09:56:16.566006 run osmo-hlr_10.42.42.2(pid=4004): Launched 09:56:16.810385 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:17.467543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4006): Launched 09:56:17.779698 run osmo-stp_10.42.42.5(pid=4007): Launched 09:56:17.899346 run osmo-msc_10.42.42.6: Starting osmo-msc 09:56:18.457131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4009): Launched 09:56:18.769675 run osmo-msc_10.42.42.6(pid=4010): Launched 09:56:18.942895 run osmo-stp_10.42.42.5(pid=4007): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4007)] 09:56:19.073940 run osmo-stp_10.42.42.5(pid=4007): stdout: | (launched: 2022-12-14_09:56:17.722006) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:19.204700 run osmo-stp_10.42.42.5(pid=4007): stderr: | 20221214095617899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095617899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095617899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095617900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095617900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095617900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095617900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:19.333989 run osmo-stp_10.42.42.5(pid=4007): stdout: | (launched: 2022-12-14_09:56:17.722006) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:19.456790 run osmo-stp_10.42.42.5(pid=4007): stderr: | 20221214095617899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095617899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095617899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095617900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095617900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095617900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095617900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:19.603370 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4007): Process ended prematurely: osmo-stp_10.42.42.5(pid=4007) [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4007)] [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:56:19.612283 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 09:56:19.639135 run osmo-hlr_10.42.42.2(pid=4004): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4004)] 09:56:19.688120 run osmo-hlr_10.42.42.2(pid=4004): stdout: | (launched: 2022-12-14_09:56:16.504430) 09:56:19.738705 run osmo-hlr_10.42.42.2(pid=4004): stderr: | 20221214095616815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095616815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095616815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095616816 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095616816 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095616816 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095616857 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095616873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095616873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095616873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:19.809030 run osmo-msc_10.42.42.6(pid=4010): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4010)] 09:56:19.857308 run osmo-msc_10.42.42.6(pid=4010): stdout: | (launched: 2022-12-14_09:56:18.711598) 09:56:19.907409 run osmo-msc_10.42.42.6(pid=4010): stderr: | 20221214095618987 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095618987 DLGLOBAL DEBUG validating counter group 0x7f2cce43ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095618987 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095618987 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095618988 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095618988 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095618990 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095618990 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095618990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095618990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:56:19.958084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4003): Terminating (SIGTERM) 09:56:19.998930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4006): Terminating (SIGTERM) 09:56:20.039447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4009): Terminating (SIGTERM) 09:56:20.080057 --- ParallelTerminationStrategy: PID 4003 died... 09:56:20.099715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4003): Terminated: ok {rc=0} 09:56:20.144412 --- ParallelTerminationStrategy: PID 4006 died... 09:56:20.163416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4006): Terminated: ok {rc=0} 09:56:20.207697 --- ParallelTerminationStrategy: PID 4009 died... 09:56:20.226686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4009): Terminated: ok {rc=0} 09:56:20.312241 bus /sierra_3: Setting Powered False 09:56:21.411008 bus /sierra_3: Setting Powered False 09:56:22.530207 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:56:23.677911 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:56:23.689768 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:56:23.747052 tst mo_mt_call_osmux.py: using LAC 40127 09:56:23.867315 tst mo_mt_call_osmux.py: using RAC 92 09:56:23.990030 tst mo_mt_call_osmux.py: using CellId 40127 09:56:24.113309 tst mo_mt_call_osmux.py: using BVCI 40128 09:56:24.226383 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:56:24.237667 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:56:24.248542 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:56:24.259482 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:56:24.270671 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:56:24.281913 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:56:24.405067 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:56:24.524605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:25.038705 run create_hlr_db(pid=4013): Launched 09:56:25.174155 bus /sierra_2: Setting Powered False 09:56:26.238859 run create_hlr_db(pid=4013): Terminated: ok {rc=0} 09:56:26.680837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4015): Launched 09:56:26.992020 run osmo-hlr_10.42.42.2(pid=4016): Launched 09:56:27.111244 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:27.643391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4018): Launched 09:56:27.956162 run osmo-stp_10.42.42.5(pid=4019): Launched 09:56:28.075549 run osmo-msc_10.42.42.6: Starting osmo-msc 09:56:28.638681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4021): Launched 09:56:28.950572 run osmo-msc_10.42.42.6(pid=4022): Launched 09:56:29.124359 run osmo-stp_10.42.42.5(pid=4019): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4019)] 09:56:29.254754 run osmo-stp_10.42.42.5(pid=4019): stdout: | (launched: 2022-12-14_09:56:27.898325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:29.385516 run osmo-stp_10.42.42.5(pid=4019): stderr: | 20221214095628071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095628071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095628071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095628072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095628074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095628074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095628074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:29.514246 run osmo-stp_10.42.42.5(pid=4019): stdout: | (launched: 2022-12-14_09:56:27.898325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:29.637140 run osmo-stp_10.42.42.5(pid=4019): stderr: | 20221214095628071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095628071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095628071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095628072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095628074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095628074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095628074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:29.783990 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4019): Process ended prematurely: osmo-stp_10.42.42.5(pid=4019) [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4019)] [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:56:29.793003 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:56:29.819516 run osmo-hlr_10.42.42.2(pid=4016): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4016)] 09:56:29.868067 run osmo-hlr_10.42.42.2(pid=4016): stdout: | (launched: 2022-12-14_09:56:26.934297) 09:56:29.918051 run osmo-hlr_10.42.42.2(pid=4016): stderr: | 20221214095627111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095627112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095627112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095627112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095627112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095627112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095627168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095627178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095627178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095627178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:29.987662 run osmo-msc_10.42.42.6(pid=4022): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4022)] 09:56:30.035302 run osmo-msc_10.42.42.6(pid=4022): stdout: | (launched: 2022-12-14_09:56:28.892433) 09:56:30.085554 run osmo-msc_10.42.42.6(pid=4022): stderr: | 20221214095629167 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095629167 DLGLOBAL DEBUG validating counter group 0x7f2f4a995c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095629167 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095629167 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095629167 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095629168 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095629169 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095629170 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095629170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095629170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:56:30.135766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4015): Terminating (SIGTERM) 09:56:30.176046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4018): Terminating (SIGTERM) 09:56:30.216487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4021): Terminating (SIGTERM) 09:56:30.257445 --- ParallelTerminationStrategy: PID 4015 died... 09:56:30.276778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4015): Terminated: ok {rc=0} 09:56:30.320848 --- ParallelTerminationStrategy: PID 4018 died... 09:56:30.340258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4018): Terminated: ok {rc=0} 09:56:30.384171 --- ParallelTerminationStrategy: PID 4021 died... 09:56:30.403044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4021): Terminated: ok {rc=0} 09:56:30.488903 bus /sierra_3: Setting Powered False 09:56:31.600386 bus /sierra_3: Setting Powered False 09:56:32.735391 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:56:33.980226 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:56:33.987467 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:56:34.008839 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:56:34.036272 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:56:34.088843 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:56:34.110637 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:56:34.137883 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:56:34.690024 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:56:34.742928 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:56:34.754367 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:56:34.812451 tst mo_mt_call.py: using LAC 40128 09:56:34.945407 tst mo_mt_call.py: using RAC 93 09:56:35.077813 tst mo_mt_call.py: using CellId 40128 09:56:35.206864 tst mo_mt_call.py: using BVCI 40129 09:56:35.327486 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:56:35.338998 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:56:35.350355 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:56:35.361746 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:56:35.373037 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:56:35.384418 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:56:35.503175 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:56:35.622510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:36.133152 run create_hlr_db(pid=4027): Launched 09:56:36.267689 bus /sierra_2: Setting Powered False 09:56:37.331630 run create_hlr_db(pid=4027): Terminated: ok {rc=0} 09:56:37.790472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4029): Launched 09:56:38.122056 run osmo-hlr_10.42.42.2(pid=4030): Launched 09:56:38.248696 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:38.815150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4032): Launched 09:56:39.146243 run osmo-stp_10.42.42.5(pid=4033): Launched 09:56:39.271861 run osmo-msc_10.42.42.6: Starting osmo-msc 09:56:39.867554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4035): Launched 09:56:40.196588 run osmo-msc_10.42.42.6(pid=4036): Launched 09:56:40.380115 run osmo-stp_10.42.42.5(pid=4033): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4033)] 09:56:40.522152 run osmo-stp_10.42.42.5(pid=4033): stdout: | (launched: 2022-12-14_09:56:39.085171) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:40.662456 run osmo-stp_10.42.42.5(pid=4033): stderr: | 20221214095639280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095639280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095639281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095639281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095639281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095639282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095639282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:40.799732 run osmo-stp_10.42.42.5(pid=4033): stdout: | (launched: 2022-12-14_09:56:39.085171) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:40.930165 run osmo-stp_10.42.42.5(pid=4033): stderr: | 20221214095639280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095639280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095639281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095639281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095639281 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095639282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095639282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:41.087024 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4033): Process ended prematurely: osmo-stp_10.42.42.5(pid=4033) [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4033)] [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:56:41.096706 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:56:41.124699 run osmo-hlr_10.42.42.2(pid=4030): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4030)] 09:56:41.175325 run osmo-hlr_10.42.42.2(pid=4030): stdout: | (launched: 2022-12-14_09:56:38.060699) 09:56:41.227304 run osmo-hlr_10.42.42.2(pid=4030): stderr: | 20221214095638261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095638261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095638261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095638261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095638261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095638261 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095638274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095638282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095638283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095638283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:41.299773 run osmo-msc_10.42.42.6(pid=4036): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4036)] 09:56:41.350003 run osmo-msc_10.42.42.6(pid=4036): stdout: | (launched: 2022-12-14_09:56:40.135609) 09:56:41.401845 run osmo-msc_10.42.42.6(pid=4036): stderr: | 20221214095640461 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095640461 DLGLOBAL DEBUG validating counter group 0x7f701bef9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095640462 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095640462 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095640462 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095640462 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095640464 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095640464 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095640464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095640464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:56:41.454070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4029): Terminating (SIGTERM) 09:56:41.495797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4032): Terminating (SIGTERM) 09:56:41.537675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4035): Terminating (SIGTERM) 09:56:41.580213 --- ParallelTerminationStrategy: PID 4029 died... 09:56:41.600220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4029): Terminated: ok {rc=0} 09:56:41.646514 --- ParallelTerminationStrategy: PID 4032 died... 09:56:41.666161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4032): Terminated: ok {rc=0} 09:56:41.712046 --- ParallelTerminationStrategy: PID 4035 died... 09:56:41.731978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4035): Terminated: ok {rc=0} 09:56:41.819485 bus /sierra_3: Setting Powered False 09:56:42.918445 bus /sierra_3: Setting Powered False 09:56:44.034593 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:56:45.184593 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:56:45.196892 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:56:45.255434 tst mo_mt_call_osmux.py: using LAC 40129 09:56:45.384539 tst mo_mt_call_osmux.py: using RAC 94 09:56:45.512882 tst mo_mt_call_osmux.py: using CellId 40129 09:56:45.643461 tst mo_mt_call_osmux.py: using BVCI 40130 09:56:45.763817 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:56:45.775447 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:56:45.786805 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:56:45.798078 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:56:45.809487 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:56:45.820887 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:56:45.962183 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:56:46.082705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:46.665637 run create_hlr_db(pid=4038): Launched 09:56:46.830454 bus /sierra_2: Setting Powered False 09:56:47.897264 run create_hlr_db(pid=4038): Terminated: ok {rc=0} 09:56:48.339173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4040): Launched 09:56:48.651919 run osmo-hlr_10.42.42.2(pid=4041): Launched 09:56:48.771906 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:49.309096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4043): Launched 09:56:49.621929 run osmo-stp_10.42.42.5(pid=4044): Launched 09:56:49.741997 run osmo-msc_10.42.42.6: Starting osmo-msc 09:56:50.300169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4046): Launched 09:56:50.611042 run osmo-msc_10.42.42.6(pid=4047): Launched 09:56:50.784691 run osmo-stp_10.42.42.5(pid=4044): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4044)] 09:56:50.914989 run osmo-stp_10.42.42.5(pid=4044): stdout: | (launched: 2022-12-14_09:56:49.563806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:51.045576 run osmo-stp_10.42.42.5(pid=4044): stderr: | 20221214095649736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095649736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095649737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095649737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095649739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095649740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095649740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:51.174031 run osmo-stp_10.42.42.5(pid=4044): stdout: | (launched: 2022-12-14_09:56:49.563806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:51.295853 run osmo-stp_10.42.42.5(pid=4044): stderr: | 20221214095649736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095649736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095649737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095649737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095649739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095649740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095649740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:51.441986 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4044): Process ended prematurely: osmo-stp_10.42.42.5(pid=4044) [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4044)] [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:56:51.450936 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:56:51.477355 run osmo-hlr_10.42.42.2(pid=4041): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4041)] 09:56:51.525930 run osmo-hlr_10.42.42.2(pid=4041): stdout: | (launched: 2022-12-14_09:56:48.593621) 09:56:51.576089 run osmo-hlr_10.42.42.2(pid=4041): stderr: | 20221214095648772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095648773 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095648773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095648773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095648773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095648773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095648785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095648794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095648795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095648795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:51.645866 run osmo-msc_10.42.42.6(pid=4047): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4047)] 09:56:51.693720 run osmo-msc_10.42.42.6(pid=4047): stdout: | (launched: 2022-12-14_09:56:50.552897) 09:56:51.743925 run osmo-msc_10.42.42.6(pid=4047): stderr: | 20221214095650828 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095650828 DLGLOBAL DEBUG validating counter group 0x7f2e1390bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095650828 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095650828 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095650828 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095650828 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095650830 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095650830 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095650831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095650831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:56:51.794046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4040): Terminating (SIGTERM) 09:56:51.834302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4043): Terminating (SIGTERM) 09:56:51.874491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4046): Terminating (SIGTERM) 09:56:51.915015 --- ParallelTerminationStrategy: PID 4040 died... 09:56:51.934409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4040): Terminated: ok {rc=0} 09:56:51.978759 --- ParallelTerminationStrategy: PID 4043 died... 09:56:51.997839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4043): Terminated: ok {rc=0} 09:56:52.042265 --- ParallelTerminationStrategy: PID 4046 died... 09:56:52.061187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4046): Terminated: ok {rc=0} 09:56:52.147900 bus /sierra_3: Setting Powered False 09:56:53.247476 bus /sierra_3: Setting Powered False 09:56:54.364363 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:56:55.599460 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:56:55.605877 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:56:55.626556 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:56:55.654119 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:56:55.708053 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:56:55.731882 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:56:55.758342 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:56:56.302867 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:56:56.353694 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:56:56.364718 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:56:56.422519 tst mo_mt_call.py: using LAC 40130 09:56:56.544868 tst mo_mt_call.py: using RAC 95 09:56:56.668138 tst mo_mt_call.py: using CellId 40130 09:56:56.791178 tst mo_mt_call.py: using BVCI 40131 09:56:56.905157 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:56:56.916127 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:56:56.927093 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:56:56.938040 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:56:56.949420 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:56:56.960719 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:56:57.079435 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:56:57.199847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:57.711911 run create_hlr_db(pid=4052): Launched 09:56:57.846836 bus /sierra_2: Setting Powered False 09:56:58.911764 run create_hlr_db(pid=4052): Terminated: ok {rc=0} 09:56:59.354695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4054): Launched 09:56:59.666861 run osmo-hlr_10.42.42.2(pid=4055): Launched 09:56:59.785274 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:00.332664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4057): Launched 09:57:00.645632 run osmo-stp_10.42.42.5(pid=4058): Launched 09:57:00.765571 run osmo-msc_10.42.42.6: Starting osmo-msc 09:57:01.383216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4060): Launched 09:57:01.726317 run osmo-msc_10.42.42.6(pid=4061): Launched 09:57:02.123078 run osmo-stp_10.42.42.5(pid=4058): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4058)] 09:57:02.323333 run osmo-stp_10.42.42.5(pid=4058): stdout: | (launched: 2022-12-14_09:57:00.587922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:02.461587 run osmo-stp_10.42.42.5(pid=4058): stderr: | 20221214095700761 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095700761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095700762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095700762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095700762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095700763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095700763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:02.599310 run osmo-stp_10.42.42.5(pid=4058): stdout: | (launched: 2022-12-14_09:57:00.587922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:02.730846 run osmo-stp_10.42.42.5(pid=4058): stderr: | 20221214095700761 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095700761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095700762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095700762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095700762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095700763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095700763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:02.887766 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4058): Process ended prematurely: osmo-stp_10.42.42.5(pid=4058) [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4058)] [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:57:02.897486 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 09:57:02.925656 run osmo-hlr_10.42.42.2(pid=4055): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4055)] 09:57:02.976493 run osmo-hlr_10.42.42.2(pid=4055): stdout: | (launched: 2022-12-14_09:56:59.608858) 09:57:03.029205 run osmo-hlr_10.42.42.2(pid=4055): stderr: | 20221214095659784 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095659784 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095659784 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095659784 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095659784 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095659784 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095659799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095659809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095659810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095659810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:03.102183 run osmo-msc_10.42.42.6(pid=4061): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4061)] 09:57:03.153151 run osmo-msc_10.42.42.6(pid=4061): stdout: | (launched: 2022-12-14_09:57:01.664700) 09:57:03.205334 run osmo-msc_10.42.42.6(pid=4061): stderr: | 20221214095702100 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095702100 DLGLOBAL DEBUG validating counter group 0x7f2e54108c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095702101 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095702101 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095702101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095702101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095702103 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095702103 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095702103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095702103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:57:03.258104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4054): Terminating (SIGTERM) 09:57:03.300592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4057): Terminating (SIGTERM) 09:57:03.343399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4060): Terminating (SIGTERM) 09:57:03.386324 --- ParallelTerminationStrategy: PID 4054 died... 09:57:03.419414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4054): Terminated: ok {rc=0} 09:57:03.478599 --- ParallelTerminationStrategy: PID 4057 died... 09:57:03.498228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4057): Terminated: ok {rc=0} 09:57:03.543318 --- ParallelTerminationStrategy: PID 4060 died... 09:57:03.562537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4060): Terminated: ok {rc=0} 09:57:03.648006 bus /sierra_3: Setting Powered False 09:57:04.747504 bus /sierra_3: Setting Powered False 09:57:05.865276 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:57:07.015255 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:57:07.027681 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:57:07.086743 tst mo_mt_call_osmux.py: using LAC 40131 09:57:07.216446 tst mo_mt_call_osmux.py: using RAC 96 09:57:07.346592 tst mo_mt_call_osmux.py: using CellId 40131 09:57:07.477942 tst mo_mt_call_osmux.py: using BVCI 40132 09:57:07.598734 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:57:07.610392 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:57:07.621855 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:57:07.633201 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:57:07.644522 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:57:07.655970 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:57:07.778286 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:57:07.901751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:08.411868 run create_hlr_db(pid=4063): Launched 09:57:08.546744 bus /sierra_2: Setting Powered False 09:57:09.611400 run create_hlr_db(pid=4063): Terminated: ok {rc=0} 09:57:10.054480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4065): Launched 09:57:10.364457 run osmo-hlr_10.42.42.2(pid=4066): Launched 09:57:10.481174 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:11.028221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4068): Launched 09:57:11.337351 run osmo-stp_10.42.42.5(pid=4069): Launched 09:57:11.456209 run osmo-msc_10.42.42.6: Starting osmo-msc 09:57:12.013515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4071): Launched 09:57:12.324199 run osmo-msc_10.42.42.6(pid=4072): Launched 09:57:12.498374 run osmo-stp_10.42.42.5(pid=4069): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4069)] 09:57:12.629708 run osmo-stp_10.42.42.5(pid=4069): stdout: | (launched: 2022-12-14_09:57:11.279763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:12.760098 run osmo-stp_10.42.42.5(pid=4069): stderr: | 20221214095711453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095711453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095711454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095711454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095711454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095711455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095711455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:12.888510 run osmo-stp_10.42.42.5(pid=4069): stdout: | (launched: 2022-12-14_09:57:11.279763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:13.010991 run osmo-stp_10.42.42.5(pid=4069): stderr: | 20221214095711453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095711453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095711454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095711454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095711454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095711455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095711455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:13.157969 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4069): Process ended prematurely: osmo-stp_10.42.42.5(pid=4069) [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4069)] [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:57:13.166919 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:57:13.193139 run osmo-hlr_10.42.42.2(pid=4066): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4066)] 09:57:13.241427 run osmo-hlr_10.42.42.2(pid=4066): stdout: | (launched: 2022-12-14_09:57:10.306426) 09:57:13.291092 run osmo-hlr_10.42.42.2(pid=4066): stderr: | 20221214095710485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095710485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095710485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095710485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095710486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095710486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095710498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095710509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095710509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095710509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:13.360341 run osmo-msc_10.42.42.6(pid=4072): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4072)] 09:57:13.407520 run osmo-msc_10.42.42.6(pid=4072): stdout: | (launched: 2022-12-14_09:57:12.266264) 09:57:13.456854 run osmo-msc_10.42.42.6(pid=4072): stderr: | 20221214095712541 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095712541 DLGLOBAL DEBUG validating counter group 0x7f408b3b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095712541 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095712541 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095712541 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095712542 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095712543 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095712544 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095712544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095712544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:57:13.506652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4065): Terminating (SIGTERM) 09:57:13.546738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4068): Terminating (SIGTERM) 09:57:13.586808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4071): Terminating (SIGTERM) 09:57:13.626815 --- ParallelTerminationStrategy: PID 4065 died... 09:57:13.646221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4065): Terminated: ok {rc=0} 09:57:13.690265 --- ParallelTerminationStrategy: PID 4068 died... 09:57:13.709134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4068): Terminated: ok {rc=0} 09:57:13.753149 --- ParallelTerminationStrategy: PID 4071 died... 09:57:13.771961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4071): Terminated: ok {rc=0} 09:57:13.858713 bus /sierra_3: Setting Powered False 09:57:14.956633 bus /sierra_3: Setting Powered False 09:57:16.068699 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:57:17.306047 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:57:17.314514 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:57:17.335975 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:57:17.363936 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:57:17.417509 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:57:17.438238 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:57:17.465085 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:57:18.018941 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:57:18.071607 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:57:18.083393 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:57:18.141860 tst mo_mt_call.py: using LAC 40132 09:57:18.271613 tst mo_mt_call.py: using RAC 97 09:57:18.399739 tst mo_mt_call.py: using CellId 40132 09:57:18.531766 tst mo_mt_call.py: using BVCI 40133 09:57:18.644807 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:57:18.656113 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:57:18.667240 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:57:18.678432 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:57:18.689948 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:57:18.701579 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:57:18.824453 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:57:18.943904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:19.424093 run create_hlr_db(pid=4077): Launched 09:57:19.542894 bus /sierra_2: Setting Powered False 09:57:20.604016 run create_hlr_db(pid=4077): Terminated: ok {rc=0} 09:57:21.036389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4079): Launched 09:57:21.347776 run osmo-hlr_10.42.42.2(pid=4080): Launched 09:57:21.467218 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:22.013943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4082): Launched 09:57:22.325615 run osmo-stp_10.42.42.5(pid=4083): Launched 09:57:22.445529 run osmo-msc_10.42.42.6: Starting osmo-msc 09:57:23.006580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4085): Launched 09:57:23.318198 run osmo-msc_10.42.42.6(pid=4086): Launched 09:57:23.493135 run osmo-stp_10.42.42.5(pid=4083): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4083)] 09:57:23.624036 run osmo-stp_10.42.42.5(pid=4083): stdout: | (launched: 2022-12-14_09:57:22.267737) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:23.754968 run osmo-stp_10.42.42.5(pid=4083): stderr: | 20221214095722441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095722442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095722442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095722442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095722443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095722443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095722443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:23.884813 run osmo-stp_10.42.42.5(pid=4083): stdout: | (launched: 2022-12-14_09:57:22.267737) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:24.008141 run osmo-stp_10.42.42.5(pid=4083): stderr: | 20221214095722441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095722442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095722442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095722442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095722443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095722443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095722443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:24.156620 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4083): Process ended prematurely: osmo-stp_10.42.42.5(pid=4083) [trial-2403↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4083)] [trial-2403↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:57:24.165915 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:57:24.192585 run osmo-hlr_10.42.42.2(pid=4080): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4080)] 09:57:24.241654 run osmo-hlr_10.42.42.2(pid=4080): stdout: | (launched: 2022-12-14_09:57:21.289404) 09:57:24.292308 run osmo-hlr_10.42.42.2(pid=4080): stderr: | 20221214095721471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095721471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095721471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095721471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095721471 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095721471 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095721483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095721491 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095721492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095721492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:24.363029 run osmo-msc_10.42.42.6(pid=4086): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4086)] 09:57:24.410973 run osmo-msc_10.42.42.6(pid=4086): stdout: | (launched: 2022-12-14_09:57:23.260207) 09:57:24.461337 run osmo-msc_10.42.42.6(pid=4086): stderr: | 20221214095723534 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095723534 DLGLOBAL DEBUG validating counter group 0x7f83f1407c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095723534 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095723534 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095723534 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095723534 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095723536 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095723536 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095723536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095723536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:57:24.512120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4079): Terminating (SIGTERM) 09:57:24.552831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4082): Terminating (SIGTERM) 09:57:24.593345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4085): Terminating (SIGTERM) 09:57:24.633971 --- ParallelTerminationStrategy: PID 4079 died... 09:57:24.653763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4079): Terminated: ok {rc=0} 09:57:24.698564 --- ParallelTerminationStrategy: PID 4082 died... 09:57:24.717953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4082): Terminated: ok {rc=0} 09:57:24.763262 --- ParallelTerminationStrategy: PID 4085 died... 09:57:24.782685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4085): Terminated: ok {rc=0} 09:57:24.871570 bus /sierra_3: Setting Powered False 09:57:25.972073 bus /sierra_3: Setting Powered False 09:57:27.090115 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:57:28.238045 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:57:28.250148 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:57:28.308563 tst mo_mt_call_osmux.py: using LAC 40133 09:57:28.431148 tst mo_mt_call_osmux.py: using RAC 98 09:57:28.554661 tst mo_mt_call_osmux.py: using CellId 40133 09:57:28.677346 tst mo_mt_call_osmux.py: using BVCI 40134 09:57:28.789670 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:57:28.800774 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:57:28.811903 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:57:28.822829 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:57:28.834069 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:57:28.845477 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:57:28.964381 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:57:29.083149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:29.563198 run create_hlr_db(pid=4089): Launched 09:57:29.699144 bus /sierra_2: Setting Powered False 09:57:30.764089 run create_hlr_db(pid=4089): Terminated: ok {rc=0} 09:57:31.235496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4091): Launched 09:57:31.566714 run osmo-hlr_10.42.42.2(pid=4092): Launched 09:57:31.792307 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:32.480796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4094): Launched 09:57:32.812826 run osmo-stp_10.42.42.5(pid=4095): Launched 09:57:32.938840 run osmo-msc_10.42.42.6: Starting osmo-msc 09:57:33.534039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4097): Launched 09:57:33.865413 run osmo-msc_10.42.42.6(pid=4098): Launched 09:57:34.049178 run osmo-stp_10.42.42.5(pid=4095): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4095)] 09:57:34.190599 run osmo-stp_10.42.42.5(pid=4095): stdout: | (launched: 2022-12-14_09:57:32.751476) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:34.327424 run osmo-stp_10.42.42.5(pid=4095): stderr: | 20221214095732946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095732946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095732947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095732947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095732949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095732950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095732950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:34.465171 run osmo-stp_10.42.42.5(pid=4095): stdout: | (launched: 2022-12-14_09:57:32.751476) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:34.595779 run osmo-stp_10.42.42.5(pid=4095): stderr: | 20221214095732946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095732946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095732947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095732947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095732949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095732950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095732950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:34.752776 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4095): Process ended prematurely: osmo-stp_10.42.42.5(pid=4095) [trial-2403↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4095)] [trial-2403↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:57:34.762570 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 09:57:34.790543 run osmo-hlr_10.42.42.2(pid=4092): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4092)] 09:57:34.841266 run osmo-hlr_10.42.42.2(pid=4092): stdout: | (launched: 2022-12-14_09:57:31.506998) 09:57:34.893448 run osmo-hlr_10.42.42.2(pid=4092): stderr: | 20221214095731864 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095731864 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095731864 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095731864 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095731865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095731865 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095731889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095731914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095731914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095731914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:34.966144 run osmo-msc_10.42.42.6(pid=4098): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4098)] 09:57:35.016409 run osmo-msc_10.42.42.6(pid=4098): stdout: | (launched: 2022-12-14_09:57:33.803839) 09:57:35.068508 run osmo-msc_10.42.42.6(pid=4098): stderr: | 20221214095734127 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095734127 DLGLOBAL DEBUG validating counter group 0x7fc3fa786c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095734127 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095734127 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095734127 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095734127 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095734129 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095734130 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095734130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095734130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:57:35.121045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4091): Terminating (SIGTERM) 09:57:35.163116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4094): Terminating (SIGTERM) 09:57:35.205070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4097): Terminating (SIGTERM) 09:57:35.247229 --- ParallelTerminationStrategy: PID 4091 died... 09:57:35.267372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4091): Terminated: ok {rc=0} 09:57:35.313809 --- ParallelTerminationStrategy: PID 4094 died... 09:57:35.333471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4094): Terminated: ok {rc=0} 09:57:35.379724 --- ParallelTerminationStrategy: PID 4097 died... 09:57:35.399396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4097): Terminated: ok {rc=0} 09:57:35.487316 bus /sierra_3: Setting Powered False 09:57:36.586796 bus /sierra_3: Setting Powered False 09:57:37.705243 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:57:38.943222 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:57:38.949264 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:57:38.970259 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:57:38.998021 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:57:39.050182 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:57:39.070901 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:57:39.097683 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:57:39.645215 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:57:39.695323 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:57:39.706453 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:57:39.763703 tst mo_mt_call.py: using LAC 40134 09:57:39.885807 tst mo_mt_call.py: using RAC 99 09:57:40.005832 tst mo_mt_call.py: using CellId 40134 09:57:40.128120 tst mo_mt_call.py: using BVCI 40135 09:57:40.241591 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:57:40.252600 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:57:40.263504 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:57:40.274500 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:57:40.285947 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:57:40.297340 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:57:40.421244 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:57:40.543009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:41.023961 run create_hlr_db(pid=4103): Launched 09:57:41.161818 bus /sierra_2: Setting Powered False 09:57:42.226273 run create_hlr_db(pid=4103): Terminated: ok {rc=0} 09:57:42.670306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4105): Launched 09:57:42.982998 run osmo-hlr_10.42.42.2(pid=4106): Launched 09:57:43.102073 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:43.653239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4108): Launched 09:57:43.966973 run osmo-stp_10.42.42.5(pid=4109): Launched 09:57:44.087283 run osmo-msc_10.42.42.6: Starting osmo-msc 09:57:44.648649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4111): Launched 09:57:44.961894 run osmo-msc_10.42.42.6(pid=4112): Launched 09:57:45.136425 run osmo-stp_10.42.42.5(pid=4109): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4109)] 09:57:45.268383 run osmo-stp_10.42.42.5(pid=4109): stdout: | (launched: 2022-12-14_09:57:43.908643) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:45.400456 run osmo-stp_10.42.42.5(pid=4109): stderr: | 20221214095744083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095744083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095744083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095744083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095744084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095744084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095744084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:45.530081 run osmo-stp_10.42.42.5(pid=4109): stdout: | (launched: 2022-12-14_09:57:43.908643) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:45.653996 run osmo-stp_10.42.42.5(pid=4109): stderr: | 20221214095744083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095744083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095744083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095744083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095744084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095744084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095744084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:45.801826 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4109): Process ended prematurely: osmo-stp_10.42.42.5(pid=4109) [trial-2403↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4109)] [trial-2403↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:57:45.810999 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:57:45.843751 run osmo-hlr_10.42.42.2(pid=4106): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4106)] 09:57:45.914672 run osmo-hlr_10.42.42.2(pid=4106): stdout: | (launched: 2022-12-14_09:57:42.925298) 09:57:45.969148 run osmo-hlr_10.42.42.2(pid=4106): stderr: | 20221214095743105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095743105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095743105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095743105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095743105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095743106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095743118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095743127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095743127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095743127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:46.045363 run osmo-msc_10.42.42.6(pid=4112): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4112)] 09:57:46.096208 run osmo-msc_10.42.42.6(pid=4112): stdout: | (launched: 2022-12-14_09:57:44.903824) 09:57:46.149392 run osmo-msc_10.42.42.6(pid=4112): stderr: | 20221214095745179 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095745180 DLGLOBAL DEBUG validating counter group 0x7fbe043a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095745180 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095745180 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095745180 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095745180 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095745182 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095745182 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095745182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095745183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:57:46.203263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4105): Terminating (SIGTERM) 09:57:46.246547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4108): Terminating (SIGTERM) 09:57:46.289467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4111): Terminating (SIGTERM) 09:57:46.333097 --- ParallelTerminationStrategy: PID 4105 died... 09:57:46.354794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4105): Terminated: ok {rc=0} 09:57:46.403613 --- ParallelTerminationStrategy: PID 4108 died... 09:57:46.426175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4108): Terminated: ok {rc=0} 09:57:46.473690 --- ParallelTerminationStrategy: PID 4111 died... 09:57:46.494981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4111): Terminated: ok {rc=0} 09:57:46.601169 bus /sierra_3: Setting Powered False 09:57:47.698236 bus /sierra_3: Setting Powered False 09:57:48.814171 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:57:49.965442 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:57:49.977544 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:57:50.037112 tst mo_mt_call_osmux.py: using LAC 40135 09:57:50.167835 tst mo_mt_call_osmux.py: using RAC 100 09:57:50.299153 tst mo_mt_call_osmux.py: using CellId 40135 09:57:50.430583 tst mo_mt_call_osmux.py: using BVCI 40136 09:57:50.550344 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:57:50.561956 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:57:50.573175 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:57:50.584295 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:57:50.595444 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:57:50.606721 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:57:50.725130 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:57:50.843755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:51.355915 run create_hlr_db(pid=4114): Launched 09:57:51.489368 bus /sierra_2: Setting Powered False 09:57:52.550936 run create_hlr_db(pid=4114): Terminated: ok {rc=0} 09:57:52.984499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4116): Launched 09:57:53.294899 run osmo-hlr_10.42.42.2(pid=4117): Launched 09:57:53.414571 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:53.949842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4119): Launched 09:57:54.259862 run osmo-stp_10.42.42.5(pid=4120): Launched 09:57:54.380124 run osmo-msc_10.42.42.6: Starting osmo-msc 09:57:54.938971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4122): Launched 09:57:55.250909 run osmo-msc_10.42.42.6(pid=4123): Launched 09:57:55.424553 run osmo-stp_10.42.42.5(pid=4120): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4120)] 09:57:55.555118 run osmo-stp_10.42.42.5(pid=4120): stdout: | (launched: 2022-12-14_09:57:54.201746) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:55.685573 run osmo-stp_10.42.42.5(pid=4120): stderr: | 20221214095754374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095754374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095754374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095754375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095754375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095754375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095754375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:55.814231 run osmo-stp_10.42.42.5(pid=4120): stdout: | (launched: 2022-12-14_09:57:54.201746) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:55.936200 run osmo-stp_10.42.42.5(pid=4120): stderr: | 20221214095754374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095754374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095754374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095754375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095754375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095754375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095754375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:56.082510 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4120): Process ended prematurely: osmo-stp_10.42.42.5(pid=4120) [trial-2403↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4120)] [trial-2403↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:57:56.091728 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:57:56.118179 run osmo-hlr_10.42.42.2(pid=4117): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4117)] 09:57:56.167016 run osmo-hlr_10.42.42.2(pid=4117): stdout: | (launched: 2022-12-14_09:57:53.237050) 09:57:56.217084 run osmo-hlr_10.42.42.2(pid=4117): stderr: | 20221214095753415 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095753415 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095753415 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095753415 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095753415 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095753415 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095753427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095753435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095753436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095753436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:56.287317 run osmo-msc_10.42.42.6(pid=4123): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4123)] 09:57:56.335016 run osmo-msc_10.42.42.6(pid=4123): stdout: | (launched: 2022-12-14_09:57:55.192860) 09:57:56.385214 run osmo-msc_10.42.42.6(pid=4123): stderr: | 20221214095755466 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095755466 DLGLOBAL DEBUG validating counter group 0x7f30d4b51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095755466 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095755466 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095755466 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095755467 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095755468 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095755469 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095755469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095755469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:57:56.435971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4116): Terminating (SIGTERM) 09:57:56.476314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4119): Terminating (SIGTERM) 09:57:56.516600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4122): Terminating (SIGTERM) 09:57:56.557215 --- ParallelTerminationStrategy: PID 4116 died... 09:57:56.576797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4116): Terminated: ok {rc=0} 09:57:56.621386 --- ParallelTerminationStrategy: PID 4119 died... 09:57:56.640592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4119): Terminated: ok {rc=0} 09:57:56.685511 --- ParallelTerminationStrategy: PID 4122 died... 09:57:56.704612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4122): Terminated: ok {rc=0} 09:57:56.789299 bus /sierra_3: Setting Powered False 09:57:57.889752 bus /sierra_3: Setting Powered False 09:57:59.007046 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 emergency:sysmo --------------------------------------------------------------------- 09:58:00.244848 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:58:00.249566 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 09:58:00.271090 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 09:58:00.298764 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 09:58:00.386203 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 09:58:00.407485 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 09:58:00.434758 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 09:58:01.021774 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2403 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 09:58:01.027762 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:58:01.039405 tst emergency:sysmo: Using 1 x bts (candidates: 1) 09:58:01.079493 tst emergency_mo_mt_call.py: using LAC 40136 09:58:01.201788 tst emergency_mo_mt_call.py: using RAC 101 09:58:01.327375 tst emergency_mo_mt_call.py: using CellId 40136 09:58:01.453642 tst emergency_mo_mt_call.py: using BVCI 40137 09:58:01.574438 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:58:01.586899 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:58:01.598876 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:58:01.610704 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:58:01.622575 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:58:01.634020 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:58:01.757174 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:58:01.906643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:02.463440 run create_hlr_db(pid=4128): Launched 09:58:02.595392 bus /sierra_2: Setting Powered False 09:58:03.659839 run create_hlr_db(pid=4128): Terminated: ok {rc=0} 09:58:04.097752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4130): Launched 09:58:04.406090 run osmo-hlr_10.42.42.2(pid=4131): Launched 09:58:04.522919 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:05.063757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4133): Launched 09:58:05.370773 run osmo-stp_10.42.42.5(pid=4134): Launched 09:58:05.497635 tst emergency_mo_mt_call.py: using MSISDN 8630 09:58:05.652872 run osmo-msc_10.42.42.6: Starting osmo-msc 09:58:06.199208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4136): Launched 09:58:06.505790 run osmo-msc_10.42.42.6(pid=4137): Launched 09:58:06.678491 run osmo-stp_10.42.42.5(pid=4134): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4134)] 09:58:06.807878 run osmo-stp_10.42.42.5(pid=4134): stdout: | (launched: 2022-12-14_09:58:05.313597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:06.936318 run osmo-stp_10.42.42.5(pid=4134): stderr: | 20221214095805487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095805487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095805487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095805488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095805488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095805488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095805488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:07.062867 run osmo-stp_10.42.42.5(pid=4134): stdout: | (launched: 2022-12-14_09:58:05.313597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:07.183623 run osmo-stp_10.42.42.5(pid=4134): stderr: | 20221214095805487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095805487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095805487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095805488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095805488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095805488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095805488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:07.328148 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4134): Process ended prematurely: osmo-stp_10.42.42.5(pid=4134) [trial-2403↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4134)] [trial-2403↪emergency:sysmo↪emergency_mo_mt_call.py:19] 09:58:07.336700 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 09:58:07.363132 run osmo-hlr_10.42.42.2(pid=4131): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4131)] 09:58:07.412602 run osmo-hlr_10.42.42.2(pid=4131): stdout: | (launched: 2022-12-14_09:58:04.348178) 09:58:07.463202 run osmo-hlr_10.42.42.2(pid=4131): stderr: | 20221214095804528 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095804528 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095804528 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095804528 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095804528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095804528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095804540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095804549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095804549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095804549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:07.533534 run osmo-msc_10.42.42.6(pid=4137): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4137)] 09:58:07.581785 run osmo-msc_10.42.42.6(pid=4137): stdout: | (launched: 2022-12-14_09:58:06.448213) 09:58:07.631906 run osmo-msc_10.42.42.6(pid=4137): stderr: | 20221214095806720 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095806720 DLGLOBAL DEBUG validating counter group 0x7f14f45e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095806720 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095806720 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095806720 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095806721 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095806722 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095806723 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095806723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095806723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:58:07.682286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4130): Terminating (SIGTERM) 09:58:07.722665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4133): Terminating (SIGTERM) 09:58:07.763211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4136): Terminating (SIGTERM) 09:58:07.804384 --- ParallelTerminationStrategy: PID 4130 died... 09:58:07.824270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4130): Terminated: ok {rc=0} 09:58:07.869404 --- ParallelTerminationStrategy: PID 4133 died... 09:58:07.888726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4133): Terminated: ok {rc=0} 09:58:07.933376 --- ParallelTerminationStrategy: PID 4136 died... 09:58:07.953181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4136): Terminated: ok {rc=0} 09:58:08.040614 bus /sierra_3: Setting Powered False 09:58:09.140525 bus /sierra_3: Setting Powered False 09:58:10.256815 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 09:58:11.345602 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:58:11.357263 tst emergency:sysmo: Using 1 x bts (candidates: 1) 09:58:11.394258 tst emergency_preemptive_call.py: using LAC 40137 09:58:11.516877 tst emergency_preemptive_call.py: using RAC 102 09:58:11.636348 tst emergency_preemptive_call.py: using CellId 40137 09:58:11.755766 tst emergency_preemptive_call.py: using BVCI 40138 09:58:11.865790 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:58:11.876392 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:58:11.887188 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:58:11.897792 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:58:11.908431 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:58:11.920645 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:58:12.044435 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:58:12.163181 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:58:12.279091 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:58:12.395808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:12.868538 run create_hlr_db(pid=4139): Launched 09:58:12.985927 bus /sierra_2: Setting Powered False 09:58:14.047191 run create_hlr_db(pid=4139): Terminated: ok {rc=0} 09:58:14.494255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4141): Launched 09:58:14.822187 run osmo-hlr_10.42.42.2(pid=4142): Launched 09:58:14.946556 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:15.505305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4144): Launched 09:58:15.842761 run osmo-stp_10.42.42.5(pid=4145): Launched 09:58:16.014309 tst emergency_preemptive_call.py: using MSISDN 8631 09:58:16.392478 run osmo-msc_10.42.42.6: Starting osmo-msc 09:58:17.001565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4147): Launched 09:58:17.327926 run osmo-msc_10.42.42.6(pid=4148): Launched 09:58:17.601888 run osmo-stp_10.42.42.5(pid=4145): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4145)] 09:58:17.739192 run osmo-stp_10.42.42.5(pid=4145): stdout: | (launched: 2022-12-14_09:58:15.771826) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:17.877704 run osmo-stp_10.42.42.5(pid=4145): stderr: | 20221214095816119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095816119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095816119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095816120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095816122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095816122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095816122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:18.013107 run osmo-stp_10.42.42.5(pid=4145): stdout: | (launched: 2022-12-14_09:58:15.771826) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:18.141988 run osmo-stp_10.42.42.5(pid=4145): stderr: | 20221214095816119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095816119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095816119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095816120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095816122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095816122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095816122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:18.295915 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4145): Process ended prematurely: osmo-stp_10.42.42.5(pid=4145) [trial-2403↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4145)] [trial-2403↪emergency:sysmo↪emergency_preemptive_call.py:32] 09:58:18.305100 tst emergency_preemptive_call.py:32: Test FAILED (7.0 sec) 09:58:18.332916 run osmo-hlr_10.42.42.2(pid=4142): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4142)] 09:58:18.384294 run osmo-hlr_10.42.42.2(pid=4142): stdout: | (launched: 2022-12-14_09:58:14.760545) 09:58:18.437288 run osmo-hlr_10.42.42.2(pid=4142): stderr: | 20221214095814963 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095814963 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095814963 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095814963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095814963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095814963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095814975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095814984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095814984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095814984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:18.510859 run osmo-msc_10.42.42.6(pid=4148): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4148)] 09:58:18.561411 run osmo-msc_10.42.42.6(pid=4148): stdout: | (launched: 2022-12-14_09:58:17.268792) 09:58:18.614464 run osmo-msc_10.42.42.6(pid=4148): stderr: | 20221214095817669 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214095817669 DLGLOBAL DEBUG validating counter group 0x7fb831494c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214095817669 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214095817669 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214095817670 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214095817670 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214095817674 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214095817675 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214095817675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214095817675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:58:18.667636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4141): Terminating (SIGTERM) 09:58:18.710235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4144): Terminating (SIGTERM) 09:58:18.752606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4147): Terminating (SIGTERM) 09:58:18.795509 --- ParallelTerminationStrategy: PID 4141 died... 09:58:18.815966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4141): Terminated: ok {rc=0} 09:58:18.863541 --- ParallelTerminationStrategy: PID 4144 died... 09:58:18.883650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4144): Terminated: ok {rc=0} 09:58:18.930125 --- ParallelTerminationStrategy: PID 4147 died... 09:58:18.950111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4147): Terminated: ok {rc=0} 09:58:19.038967 bus /sierra_9: Setting Powered False 09:58:20.137611 bus /sierra_9: Setting Powered False 09:58:21.253767 bus /sierra_8: Setting Powered False 09:58:22.351312 bus /sierra_8: Setting Powered False 09:58:23.469492 bus /sierra_3: Setting Powered False 09:58:24.568466 bus /sierra_3: Setting Powered False 09:58:25.680071 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:sysmo --------------------------------------------------------------------- 09:58:26.941256 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:58:26.945990 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 09:58:26.967468 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 09:58:27.007349 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 09:58:27.099356 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 09:58:27.120383 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 09:58:27.159042 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 09:58:27.749124 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 09:58:27.803975 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:27.814947 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:58:27.850768 tst cs_paging_gprs_active.py: using LAC 40138 09:58:27.980565 tst cs_paging_gprs_active.py: using RAC 103 09:58:28.111586 tst cs_paging_gprs_active.py: using CellId 40138 09:58:28.241716 tst cs_paging_gprs_active.py: using BVCI 40139 09:58:28.362884 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:28.374041 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:28.384907 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:28.395838 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:28.406673 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:28.417923 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:28.429320 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:28.440171 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:28.451377 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:58:28.570476 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:58:28.688700 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:58:28.897013 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:29.210442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4153): Launched 09:58:29.483923 run iperf3-srv_10.42.42.10(pid=4154): Launched 09:58:29.602255 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:58:29.810095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:30.123297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4155): Launched 09:58:30.396037 run iperf3-srv_10.42.42.10(pid=4156): Launched 09:58:30.513564 tst cs_paging_gprs_active.py:38: start network... 09:58:30.720996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:31.207517 run create_hlr_db(pid=4157): Launched 09:58:31.366191 bus /sierra_2: Setting Powered False 09:58:32.427292 run create_hlr_db(pid=4157): Terminated: ok {rc=0} 09:58:32.861289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4159): Launched 09:58:33.174362 run osmo-hlr_10.42.42.2(pid=4160): Launched 09:58:33.296116 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:33.841946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4162): Launched 09:58:34.153637 run osmo-stp_10.42.42.5(pid=4163): Launched 09:58:34.273742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:58:35.800187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4165): Launched 09:58:35.920456 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:58:36.184654 run patchelf(pid=4166): Launched 09:58:36.357685 run osmo-stp_10.42.42.5(pid=4163): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4163)] 09:58:36.489942 run osmo-stp_10.42.42.5(pid=4163): stdout: | (launched: 2022-12-14_09:58:34.095419) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:36.623306 run osmo-stp_10.42.42.5(pid=4163): stderr: | 20221214095834267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095834267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095834267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095834268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095834270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095834270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095834270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:36.757109 run osmo-stp_10.42.42.5(pid=4163): stdout: | (launched: 2022-12-14_09:58:34.095419) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:36.884255 run osmo-stp_10.42.42.5(pid=4163): stderr: | 20221214095834267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095834267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095834267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095834268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095834270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095834270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095834270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:37.035040 run patchelf(pid=4166): Terminating (SIGINT) 09:58:37.210604 run patchelf(pid=4166): Terminated: ok {rc=0} 09:58:37.337365 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4163): Process ended prematurely: osmo-stp_10.42.42.5(pid=4163) [trial-2403↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4163)] [trial-2403↪gprs:sysmo↪cs_paging_gprs_active.py:38] 09:58:37.346799 tst cs_paging_gprs_active.py:38: Test FAILED (9.6 sec) 09:58:37.374134 run osmo-hlr_10.42.42.2(pid=4160): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4160)] 09:58:37.422802 run osmo-hlr_10.42.42.2(pid=4160): stdout: | (launched: 2022-12-14_09:58:33.115599) 09:58:37.473114 run osmo-hlr_10.42.42.2(pid=4160): stderr: | 20221214095833295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095833295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095833295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095833295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095833295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095833295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095833307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095833317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095833317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095833317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:37.523751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4153): Terminating (SIGTERM) 09:58:37.564598 run iperf3-srv_10.42.42.10(pid=4154): Terminating (SIGTERM) 09:58:37.605024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4155): Terminating (SIGTERM) 09:58:37.645615 run iperf3-srv_10.42.42.10(pid=4156): Terminating (SIGTERM) 09:58:37.686210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4159): Terminating (SIGTERM) 09:58:37.726741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4162): Terminating (SIGTERM) 09:58:37.767416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4165): Terminating (SIGTERM) 09:58:37.808302 --- ParallelTerminationStrategy: PID 4153 died... 09:58:37.828098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4153): Terminated: ok {rc=0} 09:58:37.873120 --- ParallelTerminationStrategy: PID 4154 died... 09:58:37.892468 run iperf3-srv_10.42.42.10(pid=4154): Terminated {rc=256} 09:58:37.937064 --- ParallelTerminationStrategy: PID 4155 died... 09:58:37.956360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4155): Terminated: ok {rc=0} 09:58:38.001070 --- ParallelTerminationStrategy: PID 4156 died... 09:58:38.020261 run iperf3-srv_10.42.42.10(pid=4156): Terminated {rc=256} 09:58:38.064764 --- ParallelTerminationStrategy: PID 4159 died... 09:58:38.084193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4159): Terminated: ok {rc=0} 09:58:38.129071 --- ParallelTerminationStrategy: PID 4162 died... 09:58:38.148416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4162): Terminated: ok {rc=0} 09:58:38.193543 --- ParallelTerminationStrategy: PID 4165 died... 09:58:38.213054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4165): Terminated: ok {rc=0} 09:58:38.298192 bus /gobi_0: Setting Powered False 09:58:39.397746 bus /gobi_0: Setting Powered False 09:58:40.514794 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo iperf3.py ---------------------------------------------- 09:58:41.666564 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:41.678258 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:58:41.714878 tst iperf3.py: using LAC 40139 09:58:41.846747 tst iperf3.py: using RAC 104 09:58:41.977951 tst iperf3.py: using CellId 40139 09:58:42.108834 tst iperf3.py: using BVCI 40140 09:58:42.230527 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:42.241598 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:42.252519 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:42.263543 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:42.274357 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:42.285120 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:42.296116 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:42.307502 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:42.318606 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:58:42.439438 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:58:42.663147 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:42.998395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4167): Launched 09:58:43.288229 run iperf3-srv_10.42.42.10(pid=4168): Launched 09:58:43.413273 tst iperf3.py:8: start network... 09:58:43.635572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:44.147185 run create_hlr_db(pid=4169): Launched 09:58:44.281030 bus /gobi_6: Setting Powered False 09:58:45.346548 run create_hlr_db(pid=4169): Terminated: ok {rc=0} 09:58:45.789646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4171): Launched 09:58:46.145280 run osmo-hlr_10.42.42.2(pid=4172): Launched 09:58:46.386998 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:47.074009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4174): Launched 09:58:47.450394 run osmo-stp_10.42.42.5(pid=4175): Launched 09:58:47.571458 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:58:48.106416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4177): Launched 09:58:48.227276 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:58:48.490700 run patchelf(pid=4178): Launched 09:58:48.665462 run osmo-stp_10.42.42.5(pid=4175): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4175)] 09:58:48.796714 run osmo-stp_10.42.42.5(pid=4175): stdout: | (launched: 2022-12-14_09:58:47.391924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:48.929865 run osmo-stp_10.42.42.5(pid=4175): stderr: | 20221214095847567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095847567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095847567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095847568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095847568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095847568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095847568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:49.062859 run osmo-stp_10.42.42.5(pid=4175): stdout: | (launched: 2022-12-14_09:58:47.391924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:49.189752 run osmo-stp_10.42.42.5(pid=4175): stderr: | 20221214095847567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095847567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095847567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095847568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095847568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095847568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095847568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:49.339758 run patchelf(pid=4178): Terminating (SIGINT) 09:58:49.513938 run patchelf(pid=4178): Terminated: ok {rc=0} 09:58:49.639930 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4175): Process ended prematurely: osmo-stp_10.42.42.5(pid=4175) [trial-2403↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4175)] [trial-2403↪gprs:sysmo↪iperf3.py:8] 09:58:49.649729 tst iperf3.py:8: Test FAILED (8.0 sec) 09:58:49.676815 run osmo-hlr_10.42.42.2(pid=4172): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4172)] 09:58:49.725469 run osmo-hlr_10.42.42.2(pid=4172): stdout: | (launched: 2022-12-14_09:58:46.086134) 09:58:49.775942 run osmo-hlr_10.42.42.2(pid=4172): stderr: | 20221214095846414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095846414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095846414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095846414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095846414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095846414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095846427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095846438 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095846438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095846438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:49.826993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4167): Terminating (SIGTERM) 09:58:49.867935 run iperf3-srv_10.42.42.10(pid=4168): Terminating (SIGTERM) 09:58:49.908790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4171): Terminating (SIGTERM) 09:58:49.949598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4174): Terminating (SIGTERM) 09:58:49.990079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4177): Terminating (SIGTERM) 09:58:50.030971 --- ParallelTerminationStrategy: PID 4167 died... 09:58:50.050759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4167): Terminated: ok {rc=0} 09:58:50.096401 --- ParallelTerminationStrategy: PID 4168 died... 09:58:50.115909 run iperf3-srv_10.42.42.10(pid=4168): Terminated {rc=256} 09:58:50.160888 --- ParallelTerminationStrategy: PID 4171 died... 09:58:50.180791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4171): Terminated: ok {rc=0} 09:58:50.225651 --- ParallelTerminationStrategy: PID 4174 died... 09:58:50.245168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4174): Terminated: ok {rc=0} 09:58:50.289974 --- ParallelTerminationStrategy: PID 4177 died... 09:58:50.309304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4177): Terminated: ok {rc=0} 09:58:50.396879 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo iperf3m4.py ---------------------------------------------- 09:58:51.550648 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:51.562757 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:58:51.599620 tst iperf3m4.py: using LAC 40140 09:58:51.729426 tst iperf3m4.py: using RAC 105 09:58:51.859745 tst iperf3m4.py: using CellId 40140 09:58:51.989947 tst iperf3m4.py: using BVCI 40141 09:58:52.111329 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:52.122691 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:52.133971 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:52.145240 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:52.156522 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:52.167937 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:52.179211 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:52.190359 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:58:52.201504 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:58:52.320626 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:58:52.444122 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:58:52.562945 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:58:52.679773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:58:52.888806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:53.202651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4179): Launched 09:58:53.474377 run iperf3-srv_10.42.42.10(pid=4180): Launched 09:58:53.592889 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:58:53.801171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:54.114955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4181): Launched 09:58:54.388764 run iperf3-srv_10.42.42.10(pid=4182): Launched 09:58:54.506982 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:58:54.713918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:55.027136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4183): Launched 09:58:55.300611 run iperf3-srv_10.42.42.10(pid=4184): Launched 09:58:55.418704 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:58:55.625897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:58:55.937453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4185): Launched 09:58:56.222534 run iperf3-srv_10.42.42.10(pid=4186): Launched 09:58:56.339657 tst iperf3m4.py:8: start network... 09:58:56.546980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:57.029087 run create_hlr_db(pid=4187): Launched 09:58:57.164626 bus /gobi_6: Setting Powered False 09:58:58.230411 run create_hlr_db(pid=4187): Terminated: ok {rc=0} 09:58:58.675891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4189): Launched 09:58:58.989547 run osmo-hlr_10.42.42.2(pid=4190): Launched 09:58:59.107736 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:59.660431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4192): Launched 09:58:59.972455 run osmo-stp_10.42.42.5(pid=4193): Launched 09:59:00.090578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:59:00.622362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4195): Launched 09:59:00.742794 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:59:01.023526 run patchelf(pid=4196): Launched 09:59:01.240808 run osmo-stp_10.42.42.5(pid=4193): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4193)] 09:59:01.387302 run osmo-stp_10.42.42.5(pid=4193): stdout: | (launched: 2022-12-14_09:58:59.914216) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:01.534235 run osmo-stp_10.42.42.5(pid=4193): stderr: | 20221214095900088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095900088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095900088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095900088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095900089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095900089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095900089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:01.690310 run osmo-stp_10.42.42.5(pid=4193): stdout: | (launched: 2022-12-14_09:58:59.914216) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:01.850008 run osmo-stp_10.42.42.5(pid=4193): stderr: | 20221214095900088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095900088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095900088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095900088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095900089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095900089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095900089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:02.018339 run patchelf(pid=4196): Terminating (SIGINT) 09:59:02.211019 run patchelf(pid=4196): Terminated: ok {rc=0} 09:59:02.347093 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4193): Process ended prematurely: osmo-stp_10.42.42.5(pid=4193) [trial-2403↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4193)] [trial-2403↪gprs:sysmo↪iperf3m4.py:8] 09:59:02.357554 tst iperf3m4.py:8: Test FAILED (10.8 sec) 09:59:02.386804 run osmo-hlr_10.42.42.2(pid=4190): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4190)] 09:59:02.437513 run osmo-hlr_10.42.42.2(pid=4190): stdout: | (launched: 2022-12-14_09:58:58.930950) 09:59:02.489786 run osmo-hlr_10.42.42.2(pid=4190): stderr: | 20221214095859109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095859109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095859109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095859109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095859110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095859110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095859121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095859129 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095859129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095859129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:02.542696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4179): Terminating (SIGTERM) 09:59:02.585606 run iperf3-srv_10.42.42.10(pid=4180): Terminating (SIGTERM) 09:59:02.628090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4181): Terminating (SIGTERM) 09:59:02.670384 run iperf3-srv_10.42.42.10(pid=4182): Terminating (SIGTERM) 09:59:02.712727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4183): Terminating (SIGTERM) 09:59:02.755292 run iperf3-srv_10.42.42.10(pid=4184): Terminating (SIGTERM) 09:59:02.797619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4185): Terminating (SIGTERM) 09:59:02.839856 run iperf3-srv_10.42.42.10(pid=4186): Terminating (SIGTERM) 09:59:02.881891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4189): Terminating (SIGTERM) 09:59:02.924439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4192): Terminating (SIGTERM) 09:59:02.966903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4195): Terminating (SIGTERM) 09:59:03.009062 --- ParallelTerminationStrategy: PID 4179 died... 09:59:03.028841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4179): Terminated: ok {rc=0} 09:59:03.075605 --- ParallelTerminationStrategy: PID 4180 died... 09:59:03.095340 run iperf3-srv_10.42.42.10(pid=4180): Terminated {rc=256} 09:59:03.141870 --- ParallelTerminationStrategy: PID 4181 died... 09:59:03.161559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4181): Terminated: ok {rc=0} 09:59:03.207884 --- ParallelTerminationStrategy: PID 4182 died... 09:59:03.229376 run iperf3-srv_10.42.42.10(pid=4182): Terminated {rc=256} 09:59:03.276241 --- ParallelTerminationStrategy: PID 4183 died... 09:59:03.296156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4183): Terminated: ok {rc=0} 09:59:03.342748 --- ParallelTerminationStrategy: PID 4184 died... 09:59:03.362679 run iperf3-srv_10.42.42.10(pid=4184): Terminated {rc=256} 09:59:03.409168 --- ParallelTerminationStrategy: PID 4185 died... 09:59:03.428788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4185): Terminated: ok {rc=0} 09:59:03.475215 --- ParallelTerminationStrategy: PID 4186 died... 09:59:03.494885 run iperf3-srv_10.42.42.10(pid=4186): Terminated {rc=256} 09:59:03.541245 --- ParallelTerminationStrategy: PID 4189 died... 09:59:03.560795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4189): Terminated: ok {rc=0} 09:59:03.607447 --- ParallelTerminationStrategy: PID 4192 died... 09:59:03.627410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4192): Terminated: ok {rc=0} 09:59:03.673765 --- ParallelTerminationStrategy: PID 4195 died... 09:59:03.693701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4195): Terminated: ok {rc=0} 09:59:03.782310 bus /gobi_4: Setting Powered False 09:59:04.882816 bus /gobi_4: Setting Powered False 09:59:05.999034 bus /gobi_1: Setting Powered False 09:59:07.098053 bus /gobi_1: Setting Powered False 09:59:08.214360 bus /gobi_0: Setting Powered False 09:59:09.312277 bus /gobi_0: Setting Powered False 09:59:10.429947 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo ping.py ---------------------------------------------- 09:59:11.532318 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:11.543570 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:59:11.578986 tst ping.py: using LAC 40141 09:59:11.701362 tst ping.py: using RAC 106 09:59:11.820331 tst ping.py: using CellId 40141 09:59:11.947023 tst ping.py: using BVCI 40142 09:59:12.057316 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:12.067798 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:12.078360 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:12.088831 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:12.099213 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:12.109827 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:12.120403 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:12.132013 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:59:12.247373 tst ping.py:19: start network... 09:59:12.467578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:12.974060 run create_hlr_db(pid=4197): Launched 09:59:13.107327 bus /gobi_6: Setting Powered False 09:59:14.171583 run create_hlr_db(pid=4197): Terminated: ok {rc=0} 09:59:14.608294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4199): Launched 09:59:14.915527 run osmo-hlr_10.42.42.2(pid=4200): Launched 09:59:15.033351 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:15.570160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4202): Launched 09:59:15.897329 run osmo-stp_10.42.42.5(pid=4203): Launched 09:59:16.107290 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:59:16.859458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4205): Launched 09:59:16.989549 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:59:17.257626 run patchelf(pid=4206): Launched 09:59:17.447945 run osmo-stp_10.42.42.5(pid=4203): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4203)] 09:59:17.586489 run osmo-stp_10.42.42.5(pid=4203): stdout: | (launched: 2022-12-14_09:59:15.817640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:17.725810 run osmo-stp_10.42.42.5(pid=4203): stderr: | 20221214095916249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095916250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095916250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095916250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095916251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095916251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095916251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:17.865856 run osmo-stp_10.42.42.5(pid=4203): stdout: | (launched: 2022-12-14_09:59:15.817640) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:17.998823 run osmo-stp_10.42.42.5(pid=4203): stderr: | 20221214095916249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095916250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095916250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095916250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095916251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095916251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095916251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:18.156612 run patchelf(pid=4206): Terminating (SIGINT) 09:59:18.338781 run patchelf(pid=4206): Terminated: ok {rc=0} 09:59:18.470138 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4203): Process ended prematurely: osmo-stp_10.42.42.5(pid=4203) [trial-2403↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4203)] [trial-2403↪gprs:sysmo↪ping.py:22] 09:59:18.479788 tst ping.py:22: Test FAILED (6.9 sec) 09:59:18.508174 run osmo-hlr_10.42.42.2(pid=4200): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4200)] 09:59:18.558671 run osmo-hlr_10.42.42.2(pid=4200): stdout: | (launched: 2022-12-14_09:59:14.858232) 09:59:18.611839 run osmo-hlr_10.42.42.2(pid=4200): stderr: | 20221214095915037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095915037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095915037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095915037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095915037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095915037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095915051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095915062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095915062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095915062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:18.664791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4199): Terminating (SIGTERM) 09:59:18.707530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4202): Terminating (SIGTERM) 09:59:18.750223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4205): Terminating (SIGTERM) 09:59:18.793150 --- ParallelTerminationStrategy: PID 4199 died... 09:59:18.813750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4199): Terminated: ok {rc=0} 09:59:18.860515 --- ParallelTerminationStrategy: PID 4202 died... 09:59:18.880253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4202): Terminated: ok {rc=0} 09:59:18.926987 --- ParallelTerminationStrategy: PID 4205 died... 09:59:18.946855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4205): Terminated: ok {rc=0} 09:59:19.035459 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 09:59:20.124338 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:20.136193 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:59:20.172083 tst ping_idle_ping.py: using LAC 40142 09:59:20.292446 tst ping_idle_ping.py: using RAC 107 09:59:20.410658 tst ping_idle_ping.py: using CellId 40142 09:59:20.532798 tst ping_idle_ping.py: using BVCI 40143 09:59:20.644734 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:20.655376 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:20.665997 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:20.676284 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:20.686681 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:20.698791 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:20.710116 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:59:20.721366 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:59:20.851760 tst ping_idle_ping.py:24: start network... 09:59:21.071696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:21.576066 run create_hlr_db(pid=4207): Launched 09:59:21.710420 bus /gobi_6: Setting Powered False 09:59:22.774612 run create_hlr_db(pid=4207): Terminated: ok {rc=0} 09:59:23.212012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4209): Launched 09:59:23.517326 run osmo-hlr_10.42.42.2(pid=4210): Launched 09:59:23.633886 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:24.159285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4212): Launched 09:59:24.466622 run osmo-stp_10.42.42.5(pid=4213): Launched 09:59:24.585836 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:59:25.113196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4215): Launched 09:59:25.232186 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:59:25.491268 run patchelf(pid=4216): Launched 09:59:25.662541 run osmo-stp_10.42.42.5(pid=4213): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4213)] 09:59:25.792140 run osmo-stp_10.42.42.5(pid=4213): stdout: | (launched: 2022-12-14_09:59:24.409240) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:25.923733 run osmo-stp_10.42.42.5(pid=4213): stderr: | 20221214095924581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095924581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095924581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095924582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095924582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095924582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095924582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:26.055352 run osmo-stp_10.42.42.5(pid=4213): stdout: | (launched: 2022-12-14_09:59:24.409240) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:26.180491 run osmo-stp_10.42.42.5(pid=4213): stderr: | 20221214095924581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095924581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095924581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095924582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095924582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095924582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095924582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:26.329269 run patchelf(pid=4216): Terminating (SIGINT) 09:59:26.500588 run patchelf(pid=4216): Terminated: ok {rc=0} 09:59:26.624836 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4213): Process ended prematurely: osmo-stp_10.42.42.5(pid=4213) [trial-2403↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4213)] [trial-2403↪gprs:sysmo↪ping_idle_ping.py:27] 09:59:26.633976 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:59:26.660732 run osmo-hlr_10.42.42.2(pid=4210): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4210)] 09:59:26.709072 run osmo-hlr_10.42.42.2(pid=4210): stdout: | (launched: 2022-12-14_09:59:23.460131) 09:59:26.759083 run osmo-hlr_10.42.42.2(pid=4210): stderr: | 20221214095923636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095923636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095923636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095923636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095923636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095923637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095923650 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095923659 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095923659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095923659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:26.809694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4209): Terminating (SIGTERM) 09:59:26.850454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4212): Terminating (SIGTERM) 09:59:26.890901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4215): Terminating (SIGTERM) 09:59:26.931715 --- ParallelTerminationStrategy: PID 4209 died... 09:59:26.951484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4209): Terminated: ok {rc=0} 09:59:26.996208 --- ParallelTerminationStrategy: PID 4212 died... 09:59:27.015458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4212): Terminated: ok {rc=0} 09:59:27.060047 --- ParallelTerminationStrategy: PID 4215 died... 09:59:27.079220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4215): Terminated: ok {rc=0} 09:59:27.164123 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 09:59:28.450235 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:59:28.455816 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:59:28.477333 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:59:28.517198 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:59:28.606366 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:59:28.627626 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:59:28.666749 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:59:29.258965 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:59:29.309673 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:29.320545 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:59:29.356205 tst cs_paging_gprs_active.py: using LAC 40143 09:59:29.477457 tst cs_paging_gprs_active.py: using RAC 108 09:59:29.606573 tst cs_paging_gprs_active.py: using CellId 40143 09:59:29.734561 tst cs_paging_gprs_active.py: using BVCI 40144 09:59:29.855777 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:29.867327 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:29.878455 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:29.889582 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:29.900487 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:29.911582 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:29.922866 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:29.933974 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:29.945228 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:59:30.064210 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:59:30.185946 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:59:30.401677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:30.714762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4223): Launched 09:59:31.040234 run iperf3-srv_10.42.42.10(pid=4224): Launched 09:59:31.181699 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:59:31.417667 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:31.765044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4225): Launched 09:59:32.081638 run iperf3-srv_10.42.42.10(pid=4226): Launched 09:59:32.213529 tst cs_paging_gprs_active.py:38: start network... 09:59:32.422449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:32.905693 run create_hlr_db(pid=4227): Launched 09:59:33.024529 bus /gobi_6: Setting Powered False 09:59:34.085918 run create_hlr_db(pid=4227): Terminated: ok {rc=0} 09:59:34.540265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4229): Launched 09:59:34.875349 run osmo-hlr_10.42.42.2(pid=4230): Launched 09:59:35.003067 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:35.581894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4232): Launched 09:59:35.916610 run osmo-stp_10.42.42.5(pid=4233): Launched 09:59:36.044407 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:59:36.616444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4235): Launched 09:59:36.744678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:59:37.027172 run patchelf(pid=4236): Launched 09:59:37.211293 run osmo-stp_10.42.42.5(pid=4233): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4233)] 09:59:37.352324 run osmo-stp_10.42.42.5(pid=4233): stdout: | (launched: 2022-12-14_09:59:35.854827) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:37.493772 run osmo-stp_10.42.42.5(pid=4233): stderr: | 20221214095936049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095936049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095936050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095936050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095936050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095936050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095936050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:37.636128 run osmo-stp_10.42.42.5(pid=4233): stdout: | (launched: 2022-12-14_09:59:35.854827) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:37.771408 run osmo-stp_10.42.42.5(pid=4233): stderr: | 20221214095936049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095936049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095936050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095936050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095936050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095936050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095936050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:37.932311 run patchelf(pid=4236): Terminating (SIGINT) 09:59:38.118180 run patchelf(pid=4236): Terminated: ok {rc=0} 09:59:38.252147 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4233): Process ended prematurely: osmo-stp_10.42.42.5(pid=4233) [trial-2403↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4233)] [trial-2403↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:59:38.262552 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 09:59:38.291301 run osmo-hlr_10.42.42.2(pid=4230): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4230)] 09:59:38.341790 run osmo-hlr_10.42.42.2(pid=4230): stdout: | (launched: 2022-12-14_09:59:34.813472) 09:59:38.394144 run osmo-hlr_10.42.42.2(pid=4230): stderr: | 20221214095935015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095935015 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095935015 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095935015 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095935015 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095935015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095935026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095935037 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095935037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095935037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:38.446696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4223): Terminating (SIGTERM) 09:59:38.489068 run iperf3-srv_10.42.42.10(pid=4224): Terminating (SIGTERM) 09:59:38.531807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4225): Terminating (SIGTERM) 09:59:38.574695 run iperf3-srv_10.42.42.10(pid=4226): Terminating (SIGTERM) 09:59:38.616762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4229): Terminating (SIGTERM) 09:59:38.659432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4232): Terminating (SIGTERM) 09:59:38.701243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4235): Terminating (SIGTERM) 09:59:38.743541 --- ParallelTerminationStrategy: PID 4223 died... 09:59:38.763817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4223): Terminated: ok {rc=0} 09:59:38.810541 --- ParallelTerminationStrategy: PID 4224 died... 09:59:38.830442 run iperf3-srv_10.42.42.10(pid=4224): Terminated {rc=256} 09:59:38.876562 --- ParallelTerminationStrategy: PID 4225 died... 09:59:38.896633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4225): Terminated: ok {rc=0} 09:59:38.942700 --- ParallelTerminationStrategy: PID 4226 died... 09:59:38.962233 run iperf3-srv_10.42.42.10(pid=4226): Terminated {rc=256} 09:59:39.008286 --- ParallelTerminationStrategy: PID 4229 died... 09:59:39.028010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4229): Terminated: ok {rc=0} 09:59:39.074021 --- ParallelTerminationStrategy: PID 4232 died... 09:59:39.093772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4232): Terminated: ok {rc=0} 09:59:39.139917 --- ParallelTerminationStrategy: PID 4235 died... 09:59:39.159646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4235): Terminated: ok {rc=0} 09:59:39.248242 bus /gobi_0: Setting Powered False 09:59:40.348057 bus /gobi_0: Setting Powered False 09:59:41.463904 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:59:42.615541 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:42.627473 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:59:42.665707 tst iperf3.py: using LAC 40144 09:59:42.794864 tst iperf3.py: using RAC 109 09:59:42.933561 tst iperf3.py: using CellId 40144 09:59:43.062350 tst iperf3.py: using BVCI 40145 09:59:43.182227 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:43.193594 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:43.204757 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:43.216015 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:43.227144 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:43.238269 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:43.249796 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:43.260927 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:43.272387 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:59:43.392682 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:59:43.601885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:43.913699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4237): Launched 09:59:44.186161 run iperf3-srv_10.42.42.10(pid=4238): Launched 09:59:44.303568 tst iperf3.py:8: start network... 09:59:44.510377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:44.989407 run create_hlr_db(pid=4239): Launched 09:59:45.109797 bus /gobi_6: Setting Powered False 09:59:46.171629 run create_hlr_db(pid=4239): Terminated: ok {rc=0} 09:59:46.611900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4241): Launched 09:59:46.942703 run osmo-hlr_10.42.42.2(pid=4242): Launched 09:59:47.159983 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:47.766165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4244): Launched 09:59:48.100697 run osmo-stp_10.42.42.5(pid=4245): Launched 09:59:48.227614 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:59:48.800293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4247): Launched 09:59:48.927443 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:59:49.208132 run patchelf(pid=4248): Launched 09:59:49.395383 run osmo-stp_10.42.42.5(pid=4245): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4245)] 09:59:49.535012 run osmo-stp_10.42.42.5(pid=4245): stdout: | (launched: 2022-12-14_09:59:48.038981) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:49.676490 run osmo-stp_10.42.42.5(pid=4245): stderr: | 20221214095948234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095948234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095948235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095948235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095948235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095948236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095948236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:49.817182 run osmo-stp_10.42.42.5(pid=4245): stdout: | (launched: 2022-12-14_09:59:48.038981) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:49.953157 run osmo-stp_10.42.42.5(pid=4245): stderr: | 20221214095948234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214095948234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214095948235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214095948235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214095948235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214095948236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214095948236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:50.113142 run patchelf(pid=4248): Terminating (SIGINT) 09:59:50.298262 run patchelf(pid=4248): Terminated: ok {rc=0} 09:59:50.432258 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4245): Process ended prematurely: osmo-stp_10.42.42.5(pid=4245) [trial-2403↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4245)] [trial-2403↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 09:59:50.442740 tst iperf3.py:8: Test FAILED (7.9 sec) 09:59:50.471533 run osmo-hlr_10.42.42.2(pid=4242): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4242)] 09:59:50.522028 run osmo-hlr_10.42.42.2(pid=4242): stdout: | (launched: 2022-12-14_09:59:46.882778) 09:59:50.574336 run osmo-hlr_10.42.42.2(pid=4242): stderr: | 20221214095947274 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095947274 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095947274 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095947274 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095947274 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095947274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095947290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095947306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095947306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095947307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:50.627202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4237): Terminating (SIGTERM) 09:59:50.669561 run iperf3-srv_10.42.42.10(pid=4238): Terminating (SIGTERM) 09:59:50.712202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4241): Terminating (SIGTERM) 09:59:50.754973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4244): Terminating (SIGTERM) 09:59:50.797242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4247): Terminating (SIGTERM) 09:59:50.840340 --- ParallelTerminationStrategy: PID 4237 died... 09:59:50.860319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4237): Terminated: ok {rc=0} 09:59:50.906642 --- ParallelTerminationStrategy: PID 4238 died... 09:59:50.926114 run iperf3-srv_10.42.42.10(pid=4238): Terminated {rc=256} 09:59:50.971986 --- ParallelTerminationStrategy: PID 4241 died... 09:59:50.991633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4241): Terminated: ok {rc=0} 09:59:51.037872 --- ParallelTerminationStrategy: PID 4244 died... 09:59:51.057639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4244): Terminated: ok {rc=0} 09:59:51.103986 --- ParallelTerminationStrategy: PID 4247 died... 09:59:51.123669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4247): Terminated: ok {rc=0} 09:59:51.211948 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:59:52.357302 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:52.368797 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:59:52.406295 tst iperf3m4.py: using LAC 40145 09:59:52.529776 tst iperf3m4.py: using RAC 110 09:59:52.653625 tst iperf3m4.py: using CellId 40145 09:59:52.784837 tst iperf3m4.py: using BVCI 40146 09:59:52.905533 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:52.917015 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:52.928476 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:52.939712 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:52.950925 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:52.962048 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:52.973359 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:52.984327 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:59:52.995626 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:59:53.115645 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:59:53.237708 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:59:53.357686 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:59:53.474551 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:59:53.683391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:53.998307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4249): Launched 09:59:54.272344 run iperf3-srv_10.42.42.10(pid=4250): Launched 09:59:54.391079 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:59:54.598220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:54.911125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4251): Launched 09:59:55.184645 run iperf3-srv_10.42.42.10(pid=4252): Launched 09:59:55.302762 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:59:55.509861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:55.821910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4253): Launched 09:59:56.093740 run iperf3-srv_10.42.42.10(pid=4254): Launched 09:59:56.209884 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:59:56.416923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:59:56.730404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4255): Launched 09:59:57.003695 run iperf3-srv_10.42.42.10(pid=4256): Launched 09:59:57.121740 tst iperf3m4.py:8: start network... 09:59:57.329834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:57.811925 run create_hlr_db(pid=4257): Launched 09:59:57.932291 bus /gobi_6: Setting Powered False 09:59:58.994261 run create_hlr_db(pid=4257): Terminated: ok {rc=0} 09:59:59.447764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4259): Launched 09:59:59.759443 run osmo-hlr_10.42.42.2(pid=4260): Launched 09:59:59.878981 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:00.425616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4262): Launched 10:00:00.737054 run osmo-stp_10.42.42.5(pid=4263): Launched 10:00:00.896018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:00:01.653223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4268): Launched 10:00:01.809099 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:00:02.110100 run patchelf(pid=4269): Launched 10:00:02.300498 run osmo-stp_10.42.42.5(pid=4263): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4263)] 10:00:02.442885 run osmo-stp_10.42.42.5(pid=4263): stdout: | (launched: 2022-12-14_10:00:00.677904) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:02.584000 run osmo-stp_10.42.42.5(pid=4263): stderr: | 20221214100000856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100000856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100000856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100000866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100000866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100000866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100000866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:02.724698 run osmo-stp_10.42.42.5(pid=4263): stdout: | (launched: 2022-12-14_10:00:00.677904) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:02.859408 run osmo-stp_10.42.42.5(pid=4263): stderr: | 20221214100000856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100000856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100000856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100000866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100000866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100000866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100000866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:03.019589 run patchelf(pid=4269): Terminating (SIGINT) 10:00:03.204699 run patchelf(pid=4269): Terminated: ok {rc=0} 10:00:03.338713 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4263): Process ended prematurely: osmo-stp_10.42.42.5(pid=4263) [trial-2403↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4263)] [trial-2403↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 10:00:03.349414 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:00:03.378465 run osmo-hlr_10.42.42.2(pid=4260): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4260)] 10:00:03.429540 run osmo-hlr_10.42.42.2(pid=4260): stdout: | (launched: 2022-12-14_09:59:59.701050) 10:00:03.482294 run osmo-hlr_10.42.42.2(pid=4260): stderr: | 20221214095959879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214095959880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214095959880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214095959880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214095959880 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214095959880 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214095959891 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214095959899 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214095959900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214095959900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:03.535181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4249): Terminating (SIGTERM) 10:00:03.577287 run iperf3-srv_10.42.42.10(pid=4250): Terminating (SIGTERM) 10:00:03.619696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4251): Terminating (SIGTERM) 10:00:03.662300 run iperf3-srv_10.42.42.10(pid=4252): Terminating (SIGTERM) 10:00:03.704526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4253): Terminating (SIGTERM) 10:00:03.746957 run iperf3-srv_10.42.42.10(pid=4254): Terminating (SIGTERM) 10:00:03.788778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4255): Terminating (SIGTERM) 10:00:03.831023 run iperf3-srv_10.42.42.10(pid=4256): Terminating (SIGTERM) 10:00:03.872863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4259): Terminating (SIGTERM) 10:00:03.915664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4262): Terminating (SIGTERM) 10:00:03.957842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4268): Terminating (SIGTERM) 10:00:04.000662 --- ParallelTerminationStrategy: PID 4249 died... 10:00:04.020927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4249): Terminated: ok {rc=0} 10:00:04.067584 --- ParallelTerminationStrategy: PID 4250 died... 10:00:04.087375 run iperf3-srv_10.42.42.10(pid=4250): Terminated {rc=256} 10:00:04.133615 --- ParallelTerminationStrategy: PID 4251 died... 10:00:04.153618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4251): Terminated: ok {rc=0} 10:00:04.199839 --- ParallelTerminationStrategy: PID 4252 died... 10:00:04.219547 run iperf3-srv_10.42.42.10(pid=4252): Terminated {rc=256} 10:00:04.265658 --- ParallelTerminationStrategy: PID 4253 died... 10:00:04.285564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4253): Terminated: ok {rc=0} 10:00:04.331866 --- ParallelTerminationStrategy: PID 4254 died... 10:00:04.351700 run iperf3-srv_10.42.42.10(pid=4254): Terminated {rc=256} 10:00:04.398077 --- ParallelTerminationStrategy: PID 4255 died... 10:00:04.417948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4255): Terminated: ok {rc=0} 10:00:04.464092 --- ParallelTerminationStrategy: PID 4256 died... 10:00:04.483903 run iperf3-srv_10.42.42.10(pid=4256): Terminated {rc=256} 10:00:04.530827 --- ParallelTerminationStrategy: PID 4259 died... 10:00:04.550949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4259): Terminated: ok {rc=0} 10:00:04.597493 --- ParallelTerminationStrategy: PID 4262 died... 10:00:04.617344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4262): Terminated: ok {rc=0} 10:00:04.664016 --- ParallelTerminationStrategy: PID 4268 died... 10:00:04.683987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4268): Terminated: ok {rc=0} 10:00:04.772407 bus /gobi_4: Setting Powered False 10:00:05.871054 bus /gobi_4: Setting Powered False 10:00:06.987560 bus /gobi_1: Setting Powered False 10:00:08.086970 bus /gobi_1: Setting Powered False 10:00:09.204479 bus /gobi_0: Setting Powered False 10:00:10.302844 bus /gobi_0: Setting Powered False 10:00:11.420733 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 10:00:12.524288 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:12.536212 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:00:12.574526 tst ping.py: using LAC 40146 10:00:12.697340 tst ping.py: using RAC 111 10:00:12.818801 tst ping.py: using CellId 40146 10:00:12.939882 tst ping.py: using BVCI 40147 10:00:13.051832 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:13.062674 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:13.073427 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:13.084005 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:13.095467 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:13.107058 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:13.118602 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:13.130121 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:00:13.253921 tst ping.py:19: start network... 10:00:13.474799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:13.980556 run create_hlr_db(pid=4270): Launched 10:00:14.112790 bus /gobi_6: Setting Powered False 10:00:15.177772 run create_hlr_db(pid=4270): Terminated: ok {rc=0} 10:00:15.634129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4272): Launched 10:00:15.979123 run osmo-hlr_10.42.42.2(pid=4273): Launched 10:00:16.228191 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:16.898031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4275): Launched 10:00:17.236888 run osmo-stp_10.42.42.5(pid=4276): Launched 10:00:17.360255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:00:17.925370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4278): Launched 10:00:18.049418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:00:18.325697 run patchelf(pid=4279): Launched 10:00:18.507226 run osmo-stp_10.42.42.5(pid=4276): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4276)] 10:00:18.644479 run osmo-stp_10.42.42.5(pid=4276): stdout: | (launched: 2022-12-14_10:00:17.175956) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:18.783341 run osmo-stp_10.42.42.5(pid=4276): stderr: | 20221214100017371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100017371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100017371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100017372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100017372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100017372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100017372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:18.923415 run osmo-stp_10.42.42.5(pid=4276): stdout: | (launched: 2022-12-14_10:00:17.175956) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:19.056264 run osmo-stp_10.42.42.5(pid=4276): stderr: | 20221214100017371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100017371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100017371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100017372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100017372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100017372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100017372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:19.213805 run patchelf(pid=4279): Terminating (SIGINT) 10:00:19.395894 run patchelf(pid=4279): Terminated: ok {rc=0} 10:00:19.527407 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4276): Process ended prematurely: osmo-stp_10.42.42.5(pid=4276) [trial-2403↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4276)] [trial-2403↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 10:00:19.537575 tst ping.py:22: Test FAILED (7.0 sec) 10:00:19.566411 run osmo-hlr_10.42.42.2(pid=4273): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4273)] 10:00:19.617586 run osmo-hlr_10.42.42.2(pid=4273): stdout: | (launched: 2022-12-14_10:00:15.916759) 10:00:19.670038 run osmo-hlr_10.42.42.2(pid=4273): stderr: | 20221214100016223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100016223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100016224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100016224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100016224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100016224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100016247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100016263 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100016263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100016263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:19.723005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4272): Terminating (SIGTERM) 10:00:19.765493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4275): Terminating (SIGTERM) 10:00:19.808166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4278): Terminating (SIGTERM) 10:00:19.850862 --- ParallelTerminationStrategy: PID 4272 died... 10:00:19.871396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4272): Terminated: ok {rc=0} 10:00:19.918091 --- ParallelTerminationStrategy: PID 4275 died... 10:00:19.937973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4275): Terminated: ok {rc=0} 10:00:19.984273 --- ParallelTerminationStrategy: PID 4278 died... 10:00:20.004219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4278): Terminated: ok {rc=0} 10:00:20.094618 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:00:21.183486 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:21.195725 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:00:21.235147 tst ping_idle_ping.py: using LAC 40147 10:00:21.362352 tst ping_idle_ping.py: using RAC 112 10:00:21.491703 tst ping_idle_ping.py: using CellId 40147 10:00:21.620901 tst ping_idle_ping.py: using BVCI 40148 10:00:21.740476 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:21.751886 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:21.763189 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:21.774313 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:21.785401 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:21.796458 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:21.807748 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:00:21.818974 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:00:21.945316 tst ping_idle_ping.py:24: start network... 10:00:22.149905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:22.622142 run create_hlr_db(pid=4280): Launched 10:00:22.741064 bus /gobi_6: Setting Powered False 10:00:23.802287 run create_hlr_db(pid=4280): Terminated: ok {rc=0} 10:00:24.251192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4282): Launched 10:00:24.579618 run osmo-hlr_10.42.42.2(pid=4283): Launched 10:00:24.705967 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:25.268898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4285): Launched 10:00:25.595426 run osmo-stp_10.42.42.5(pid=4286): Launched 10:00:25.720468 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:00:26.286329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4288): Launched 10:00:26.410631 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:00:26.687295 run patchelf(pid=4289): Launched 10:00:26.869725 run osmo-stp_10.42.42.5(pid=4286): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4286)] 10:00:27.007408 run osmo-stp_10.42.42.5(pid=4286): stdout: | (launched: 2022-12-14_10:00:25.534428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:27.146995 run osmo-stp_10.42.42.5(pid=4286): stderr: | 20221214100025730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100025730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100025730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100025731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100025731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100025731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100025731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:27.286874 run osmo-stp_10.42.42.5(pid=4286): stdout: | (launched: 2022-12-14_10:00:25.534428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:27.420015 run osmo-stp_10.42.42.5(pid=4286): stderr: | 20221214100025730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100025730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100025730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100025731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100025731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100025731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100025731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:27.578346 run patchelf(pid=4289): Terminating (SIGINT) 10:00:27.761589 run patchelf(pid=4289): Terminated: ok {rc=0} 10:00:27.894924 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4286): Process ended prematurely: osmo-stp_10.42.42.5(pid=4286) [trial-2403↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4286)] [trial-2403↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 10:00:27.908572 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:00:27.936323 run osmo-hlr_10.42.42.2(pid=4283): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4283)] 10:00:27.991238 run osmo-hlr_10.42.42.2(pid=4283): stdout: | (launched: 2022-12-14_10:00:24.518867) 10:00:28.074365 run osmo-hlr_10.42.42.2(pid=4283): stderr: | 20221214100024722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100024722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100024722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100024722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100024722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100024722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100024734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100024742 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100024742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100024742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:28.132082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4282): Terminating (SIGTERM) 10:00:28.172448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4285): Terminating (SIGTERM) 10:00:28.213478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4288): Terminating (SIGTERM) 10:00:28.254970 --- ParallelTerminationStrategy: PID 4282 died... 10:00:28.275190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4282): Terminated: ok {rc=0} 10:00:28.320513 --- ParallelTerminationStrategy: PID 4285 died... 10:00:28.340207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4285): Terminated: ok {rc=0} 10:00:28.385288 --- ParallelTerminationStrategy: PID 4288 died... 10:00:28.404992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4288): Terminated: ok {rc=0} 10:00:28.492914 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:00:29.778533 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:00:29.784413 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:00:29.805157 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:00:29.845424 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:00:29.934214 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:00:29.954998 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:00:29.994105 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:00:30.586124 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:00:30.636620 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:30.647510 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:00:30.704718 tst cs_paging_gprs_active.py: using LAC 40148 10:00:30.826496 tst cs_paging_gprs_active.py: using RAC 113 10:00:30.986116 tst cs_paging_gprs_active.py: using CellId 40148 10:00:31.109794 tst cs_paging_gprs_active.py: using BVCI 40149 10:00:31.228805 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:31.241145 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:31.253072 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:31.265155 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:31.277897 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:31.290564 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:31.303193 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:31.315899 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:31.329095 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:00:31.480652 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:00:31.624807 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:00:31.891180 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:00:32.233947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4293): Launched 10:00:32.527949 run iperf3-srv_10.42.42.10(pid=4294): Launched 10:00:32.654813 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:00:32.879233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:00:33.214960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4295): Launched 10:00:33.505629 run iperf3-srv_10.42.42.10(pid=4296): Launched 10:00:33.631766 tst cs_paging_gprs_active.py:38: start network... 10:00:33.857016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:34.372843 run create_hlr_db(pid=4297): Launched 10:00:34.507667 bus /gobi_6: Setting Powered False 10:00:35.573858 run create_hlr_db(pid=4297): Terminated: ok {rc=0} 10:00:36.020552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4299): Launched 10:00:36.335032 run osmo-hlr_10.42.42.2(pid=4300): Launched 10:00:36.456141 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:36.993898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4302): Launched 10:00:37.307222 run osmo-stp_10.42.42.5(pid=4303): Launched 10:00:37.426981 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:00:37.967353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4305): Launched 10:00:38.087949 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:00:38.352870 run patchelf(pid=4306): Launched 10:00:38.527375 run osmo-stp_10.42.42.5(pid=4303): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4303)] 10:00:38.659520 run osmo-stp_10.42.42.5(pid=4303): stdout: | (launched: 2022-12-14_10:00:37.248269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:38.792607 run osmo-stp_10.42.42.5(pid=4303): stderr: | 20221214100037421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100037421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100037421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100037421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100037424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100037424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100037424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:38.925971 run osmo-stp_10.42.42.5(pid=4303): stdout: | (launched: 2022-12-14_10:00:37.248269) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:39.053351 run osmo-stp_10.42.42.5(pid=4303): stderr: | 20221214100037421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100037421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100037421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100037421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100037424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100037424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100037424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:39.203977 run patchelf(pid=4306): Terminating (SIGINT) 10:00:39.379692 run patchelf(pid=4306): Terminated: ok {rc=0} 10:00:39.506125 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4303): Process ended prematurely: osmo-stp_10.42.42.5(pid=4303) [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4303)] [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:00:39.515682 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 10:00:39.543151 run osmo-hlr_10.42.42.2(pid=4300): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4300)] 10:00:39.591814 run osmo-hlr_10.42.42.2(pid=4300): stdout: | (launched: 2022-12-14_10:00:36.276408) 10:00:39.642076 run osmo-hlr_10.42.42.2(pid=4300): stderr: | 20221214100036454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100036454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100036454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100036454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100036454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100036454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100036466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100036474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100036475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100036475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:39.693039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4293): Terminating (SIGTERM) 10:00:39.733585 run iperf3-srv_10.42.42.10(pid=4294): Terminating (SIGTERM) 10:00:39.773930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4295): Terminating (SIGTERM) 10:00:39.814353 run iperf3-srv_10.42.42.10(pid=4296): Terminating (SIGTERM) 10:00:39.854969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4299): Terminating (SIGTERM) 10:00:39.895492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4302): Terminating (SIGTERM) 10:00:39.935775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4305): Terminating (SIGTERM) 10:00:39.976555 --- ParallelTerminationStrategy: PID 4293 died... 10:00:39.996201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4293): Terminated: ok {rc=0} 10:00:40.040784 --- ParallelTerminationStrategy: PID 4294 died... 10:00:40.060017 run iperf3-srv_10.42.42.10(pid=4294): Terminated {rc=256} 10:00:40.104405 --- ParallelTerminationStrategy: PID 4295 died... 10:00:40.123647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4295): Terminated: ok {rc=0} 10:00:40.168086 --- ParallelTerminationStrategy: PID 4296 died... 10:00:40.187153 run iperf3-srv_10.42.42.10(pid=4296): Terminated {rc=256} 10:00:40.231365 --- ParallelTerminationStrategy: PID 4299 died... 10:00:40.250596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4299): Terminated: ok {rc=0} 10:00:40.294952 --- ParallelTerminationStrategy: PID 4302 died... 10:00:40.314224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4302): Terminated: ok {rc=0} 10:00:40.358648 --- ParallelTerminationStrategy: PID 4305 died... 10:00:40.377722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4305): Terminated: ok {rc=0} 10:00:40.464590 bus /gobi_0: Setting Powered False 10:00:41.564289 bus /gobi_0: Setting Powered False 10:00:42.679461 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:00:43.829156 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:43.840557 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:00:43.900055 tst iperf3.py: using LAC 40149 10:00:44.022947 tst iperf3.py: using RAC 114 10:00:44.146254 tst iperf3.py: using CellId 40149 10:00:44.269395 tst iperf3.py: using BVCI 40150 10:00:44.381977 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:44.392834 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:44.403548 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:44.414292 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:44.425268 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:44.436119 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:44.447799 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:44.458731 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:44.469959 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:00:44.587480 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:00:44.811915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:00:45.147291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4307): Launched 10:00:45.439231 run iperf3-srv_10.42.42.10(pid=4308): Launched 10:00:45.563304 tst iperf3.py:8: start network... 10:00:45.787367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:46.313205 run create_hlr_db(pid=4309): Launched 10:00:46.481672 bus /gobi_6: Setting Powered False 10:00:47.544701 run create_hlr_db(pid=4309): Terminated: ok {rc=0} 10:00:47.991661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4311): Launched 10:00:48.305156 run osmo-hlr_10.42.42.2(pid=4312): Launched 10:00:48.423811 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:48.971427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4314): Launched 10:00:49.284626 run osmo-stp_10.42.42.5(pid=4315): Launched 10:00:49.402661 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:00:49.936653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4317): Launched 10:00:50.057372 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:00:50.320429 run patchelf(pid=4318): Launched 10:00:50.495112 run osmo-stp_10.42.42.5(pid=4315): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4315)] 10:00:50.626102 run osmo-stp_10.42.42.5(pid=4315): stdout: | (launched: 2022-12-14_10:00:49.225565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:50.758644 run osmo-stp_10.42.42.5(pid=4315): stderr: | 20221214100049402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100049402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100049403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100049403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100049404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100049404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100049404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:50.891082 run osmo-stp_10.42.42.5(pid=4315): stdout: | (launched: 2022-12-14_10:00:49.225565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:51.017504 run osmo-stp_10.42.42.5(pid=4315): stderr: | 20221214100049402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100049402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100049403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100049403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100049404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100049404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100049404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:51.167329 run patchelf(pid=4318): Terminating (SIGINT) 10:00:51.341374 run patchelf(pid=4318): Terminated: ok {rc=0} 10:00:51.467494 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4315): Process ended prematurely: osmo-stp_10.42.42.5(pid=4315) [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4315)] [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 10:00:51.477276 tst iperf3.py:8: Test FAILED (7.7 sec) 10:00:51.504623 run osmo-hlr_10.42.42.2(pid=4312): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4312)] 10:00:51.553346 run osmo-hlr_10.42.42.2(pid=4312): stdout: | (launched: 2022-12-14_10:00:48.246779) 10:00:51.603602 run osmo-hlr_10.42.42.2(pid=4312): stderr: | 20221214100048426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100048426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100048426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100048426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100048426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100048426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100048438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100048448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100048448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100048448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:51.654334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4307): Terminating (SIGTERM) 10:00:51.695603 run iperf3-srv_10.42.42.10(pid=4308): Terminating (SIGTERM) 10:00:51.736741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4311): Terminating (SIGTERM) 10:00:51.777876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4314): Terminating (SIGTERM) 10:00:51.819174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4317): Terminating (SIGTERM) 10:00:51.860585 --- ParallelTerminationStrategy: PID 4307 died... 10:00:51.880280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4307): Terminated: ok {rc=0} 10:00:51.925404 --- ParallelTerminationStrategy: PID 4308 died... 10:00:51.944377 run iperf3-srv_10.42.42.10(pid=4308): Terminated {rc=256} 10:00:51.994267 --- ParallelTerminationStrategy: PID 4311 died... 10:00:52.015124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4311): Terminated: ok {rc=0} 10:00:52.066689 --- ParallelTerminationStrategy: PID 4314 died... 10:00:52.085825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4314): Terminated: ok {rc=0} 10:00:52.130861 --- ParallelTerminationStrategy: PID 4317 died... 10:00:52.150558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4317): Terminated: ok {rc=0} 10:00:52.239028 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:00:53.394598 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:53.406671 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:00:53.467356 tst iperf3m4.py: using LAC 40150 10:00:53.590555 tst iperf3m4.py: using RAC 115 10:00:53.714221 tst iperf3m4.py: using CellId 40150 10:00:53.835565 tst iperf3m4.py: using BVCI 40151 10:00:53.950190 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:53.961435 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:53.972268 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:53.983009 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:53.994183 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:54.005177 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:54.016468 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:54.027601 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:00:54.038984 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:00:54.162484 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:00:54.284604 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:00:54.407710 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:00:54.526093 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:00:54.734706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:00:55.048402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4321): Launched 10:00:55.321389 run iperf3-srv_10.42.42.10(pid=4322): Launched 10:00:55.440048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:00:55.647921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:00:55.962721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4323): Launched 10:00:56.237381 run iperf3-srv_10.42.42.10(pid=4324): Launched 10:00:56.355451 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:00:56.564426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:00:56.879180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4325): Launched 10:00:57.153999 run iperf3-srv_10.42.42.10(pid=4326): Launched 10:00:57.272754 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:00:57.481692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:00:57.796138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4327): Launched 10:00:58.071935 run iperf3-srv_10.42.42.10(pid=4328): Launched 10:00:58.188406 tst iperf3m4.py:8: start network... 10:00:58.396574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:58.879996 run create_hlr_db(pid=4329): Launched 10:00:58.998230 bus /gobi_6: Setting Powered False 10:01:00.059952 run create_hlr_db(pid=4329): Terminated: ok {rc=0} 10:01:00.494758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4331): Launched 10:01:00.806984 run osmo-hlr_10.42.42.2(pid=4332): Launched 10:01:01.047405 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:01.766936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4334): Launched 10:01:02.121838 run osmo-stp_10.42.42.5(pid=4335): Launched 10:01:02.301393 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:01:02.847139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4337): Launched 10:01:02.966466 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:01:03.230116 run patchelf(pid=4338): Launched 10:01:03.402701 run osmo-stp_10.42.42.5(pid=4335): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4335)] 10:01:03.532919 run osmo-stp_10.42.42.5(pid=4335): stdout: | (launched: 2022-12-14_10:01:02.056617) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:03.664941 run osmo-stp_10.42.42.5(pid=4335): stderr: | 20221214100102296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100102297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100102297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100102297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100102298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100102298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100102298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:03.796839 run osmo-stp_10.42.42.5(pid=4335): stdout: | (launched: 2022-12-14_10:01:02.056617) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:03.923631 run osmo-stp_10.42.42.5(pid=4335): stderr: | 20221214100102296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100102297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100102297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100102297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100102298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100102298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100102298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:04.073070 run patchelf(pid=4338): Terminating (SIGINT) 10:01:04.246342 run patchelf(pid=4338): Terminated: ok {rc=0} 10:01:04.371754 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4335): Process ended prematurely: osmo-stp_10.42.42.5(pid=4335) [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4335)] [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:01:04.381574 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:01:04.408795 run osmo-hlr_10.42.42.2(pid=4332): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4332)] 10:01:04.457353 run osmo-hlr_10.42.42.2(pid=4332): stdout: | (launched: 2022-12-14_10:01:00.747803) 10:01:04.507111 run osmo-hlr_10.42.42.2(pid=4332): stderr: | 20221214100101019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100101019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100101020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100101020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100101020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100101020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100101039 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100101052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100101057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100101058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:04.557559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4321): Terminating (SIGTERM) 10:01:04.597947 run iperf3-srv_10.42.42.10(pid=4322): Terminating (SIGTERM) 10:01:04.638395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4323): Terminating (SIGTERM) 10:01:04.678869 run iperf3-srv_10.42.42.10(pid=4324): Terminating (SIGTERM) 10:01:04.719144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4325): Terminating (SIGTERM) 10:01:04.759543 run iperf3-srv_10.42.42.10(pid=4326): Terminating (SIGTERM) 10:01:04.799806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4327): Terminating (SIGTERM) 10:01:04.840073 run iperf3-srv_10.42.42.10(pid=4328): Terminating (SIGTERM) 10:01:04.880697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4331): Terminating (SIGTERM) 10:01:04.921458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4334): Terminating (SIGTERM) 10:01:04.962329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4337): Terminating (SIGTERM) 10:01:05.003383 --- ParallelTerminationStrategy: PID 4321 died... 10:01:05.023205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4321): Terminated: ok {rc=0} 10:01:05.068052 --- ParallelTerminationStrategy: PID 4322 died... 10:01:05.087657 run iperf3-srv_10.42.42.10(pid=4322): Terminated {rc=256} 10:01:05.132364 --- ParallelTerminationStrategy: PID 4323 died... 10:01:05.151684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4323): Terminated: ok {rc=0} 10:01:05.196432 --- ParallelTerminationStrategy: PID 4324 died... 10:01:05.215566 run iperf3-srv_10.42.42.10(pid=4324): Terminated {rc=256} 10:01:05.259791 --- ParallelTerminationStrategy: PID 4325 died... 10:01:05.279110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4325): Terminated: ok {rc=0} 10:01:05.323937 --- ParallelTerminationStrategy: PID 4326 died... 10:01:05.343072 run iperf3-srv_10.42.42.10(pid=4326): Terminated {rc=256} 10:01:05.387436 --- ParallelTerminationStrategy: PID 4327 died... 10:01:05.406907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4327): Terminated: ok {rc=0} 10:01:05.451486 --- ParallelTerminationStrategy: PID 4328 died... 10:01:05.470850 run iperf3-srv_10.42.42.10(pid=4328): Terminated {rc=256} 10:01:05.515231 --- ParallelTerminationStrategy: PID 4331 died... 10:01:05.534693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4331): Terminated: ok {rc=0} 10:01:05.579472 --- ParallelTerminationStrategy: PID 4334 died... 10:01:05.598877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4334): Terminated: ok {rc=0} 10:01:05.643771 --- ParallelTerminationStrategy: PID 4337 died... 10:01:05.663230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4337): Terminated: ok {rc=0} 10:01:05.750795 bus /gobi_4: Setting Powered False 10:01:06.850367 bus /gobi_4: Setting Powered False 10:01:07.965559 bus /gobi_1: Setting Powered False 10:01:09.065722 bus /gobi_1: Setting Powered False 10:01:10.182783 bus /gobi_0: Setting Powered False 10:01:11.282608 bus /gobi_0: Setting Powered False 10:01:12.400332 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:01:13.500941 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:13.512523 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:01:13.571271 tst ping.py: using LAC 40151 10:01:13.690701 tst ping.py: using RAC 116 10:01:13.822120 tst ping.py: using CellId 40151 10:01:13.949687 tst ping.py: using BVCI 40152 10:01:14.068850 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:14.080619 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:14.092171 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:14.103677 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:14.114883 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:14.126084 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:14.137466 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:14.148643 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:01:14.265619 tst ping.py:19: start network... 10:01:14.470310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:14.944694 run create_hlr_db(pid=4339): Launched 10:01:15.061096 bus /gobi_6: Setting Powered False 10:01:16.143820 run create_hlr_db(pid=4339): Terminated: ok {rc=0} 10:01:16.674131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4341): Launched 10:01:17.000218 run osmo-hlr_10.42.42.2(pid=4342): Launched 10:01:17.117145 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:17.702446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4344): Launched 10:01:18.011131 run osmo-stp_10.42.42.5(pid=4345): Launched 10:01:18.129256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:01:18.660143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4347): Launched 10:01:18.778237 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:01:19.036365 run patchelf(pid=4348): Launched 10:01:19.206762 run osmo-stp_10.42.42.5(pid=4345): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4345)] 10:01:19.336050 run osmo-stp_10.42.42.5(pid=4345): stdout: | (launched: 2022-12-14_10:01:17.953281) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:19.466730 run osmo-stp_10.42.42.5(pid=4345): stderr: | 20221214100118126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100118126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100118126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100118127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100118129 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100118129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100118129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:19.596792 run osmo-stp_10.42.42.5(pid=4345): stdout: | (launched: 2022-12-14_10:01:17.953281) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:19.721201 run osmo-stp_10.42.42.5(pid=4345): stderr: | 20221214100118126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100118126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100118126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100118127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100118129 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100118129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100118129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:19.868390 run patchelf(pid=4348): Terminating (SIGINT) 10:01:20.039826 run patchelf(pid=4348): Terminated: ok {rc=0} 10:01:20.163767 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4345): Process ended prematurely: osmo-stp_10.42.42.5(pid=4345) [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4345)] [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 10:01:20.172798 tst ping.py:22: Test FAILED (6.7 sec) 10:01:20.199519 run osmo-hlr_10.42.42.2(pid=4342): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4342)] 10:01:20.247999 run osmo-hlr_10.42.42.2(pid=4342): stdout: | (launched: 2022-12-14_10:01:16.938639) 10:01:20.297911 run osmo-hlr_10.42.42.2(pid=4342): stderr: | 20221214100117285 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100117285 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100117285 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100117285 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100117285 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100117285 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100117296 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100117304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100117305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100117305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:20.348085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4341): Terminating (SIGTERM) 10:01:20.388233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4344): Terminating (SIGTERM) 10:01:20.428355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4347): Terminating (SIGTERM) 10:01:20.468898 --- ParallelTerminationStrategy: PID 4341 died... 10:01:20.488544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4341): Terminated: ok {rc=0} 10:01:20.532724 --- ParallelTerminationStrategy: PID 4344 died... 10:01:20.551661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4344): Terminated: ok {rc=0} 10:01:20.595561 --- ParallelTerminationStrategy: PID 4347 died... 10:01:20.614599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4347): Terminated: ok {rc=0} 10:01:20.700496 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:01:21.788929 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:21.800645 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:01:21.862994 tst ping_idle_ping.py: using LAC 40152 10:01:21.984472 tst ping_idle_ping.py: using RAC 117 10:01:22.102542 tst ping_idle_ping.py: using CellId 40152 10:01:22.220684 tst ping_idle_ping.py: using BVCI 40153 10:01:22.331507 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:22.342604 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:22.353303 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:22.364102 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:22.375608 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:22.387074 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:22.398897 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:01:22.410617 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:01:22.534723 tst ping_idle_ping.py:24: start network... 10:01:22.754225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:23.261127 run create_hlr_db(pid=4349): Launched 10:01:23.394756 bus /gobi_6: Setting Powered False 10:01:24.459114 run create_hlr_db(pid=4349): Terminated: ok {rc=0} 10:01:24.898422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4351): Launched 10:01:25.208455 run osmo-hlr_10.42.42.2(pid=4352): Launched 10:01:25.326348 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:25.870487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4354): Launched 10:01:26.179605 run osmo-stp_10.42.42.5(pid=4355): Launched 10:01:26.298169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:01:26.825980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4357): Launched 10:01:26.945245 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:01:27.204781 run patchelf(pid=4358): Launched 10:01:27.376717 run osmo-stp_10.42.42.5(pid=4355): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4355)] 10:01:27.506302 run osmo-stp_10.42.42.5(pid=4355): stdout: | (launched: 2022-12-14_10:01:26.122282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:27.637254 run osmo-stp_10.42.42.5(pid=4355): stderr: | 20221214100126293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100126293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100126293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100126294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100126296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100126296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100126296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:27.768568 run osmo-stp_10.42.42.5(pid=4355): stdout: | (launched: 2022-12-14_10:01:26.122282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:27.893972 run osmo-stp_10.42.42.5(pid=4355): stderr: | 20221214100126293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100126293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100126293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100126294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100126296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100126296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100126296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:28.042520 run patchelf(pid=4358): Terminating (SIGINT) 10:01:28.215668 run patchelf(pid=4358): Terminated: ok {rc=0} 10:01:28.340040 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4355): Process ended prematurely: osmo-stp_10.42.42.5(pid=4355) [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4355)] [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:01:28.349754 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:01:28.376497 run osmo-hlr_10.42.42.2(pid=4352): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4352)] 10:01:28.425589 run osmo-hlr_10.42.42.2(pid=4352): stdout: | (launched: 2022-12-14_10:01:25.150840) 10:01:28.475905 run osmo-hlr_10.42.42.2(pid=4352): stderr: | 20221214100125329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100125329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100125329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100125329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100125329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100125329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100125342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100125350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100125350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100125350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:28.526599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4351): Terminating (SIGTERM) 10:01:28.567125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4354): Terminating (SIGTERM) 10:01:28.607580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4357): Terminating (SIGTERM) 10:01:28.648780 --- ParallelTerminationStrategy: PID 4351 died... 10:01:28.668657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4351): Terminated: ok {rc=0} 10:01:28.713653 --- ParallelTerminationStrategy: PID 4354 died... 10:01:28.732917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4354): Terminated: ok {rc=0} 10:01:28.777759 --- ParallelTerminationStrategy: PID 4357 died... 10:01:28.797264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4357): Terminated: ok {rc=0} 10:01:28.885041 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:01:30.174230 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:01:30.180182 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:01:30.200878 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:01:30.239664 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:01:30.326228 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:01:30.346918 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:01:30.385196 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:01:31.003698 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:01:31.063562 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:31.075989 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:01:31.137225 tst cs_paging_gprs_active.py: using LAC 40153 10:01:31.263938 tst cs_paging_gprs_active.py: using RAC 118 10:01:31.425790 tst cs_paging_gprs_active.py: using CellId 40153 10:01:31.559690 tst cs_paging_gprs_active.py: using BVCI 40154 10:01:31.675152 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:31.686556 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:31.697848 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:31.709236 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:31.720533 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:31.732106 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:31.743675 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:31.755057 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:31.766719 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:01:31.890256 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:01:32.038489 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:01:32.278661 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:01:32.616772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4363): Launched 10:01:32.908464 run iperf3-srv_10.42.42.10(pid=4364): Launched 10:01:33.034443 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:01:33.258418 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:01:33.592603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4365): Launched 10:01:33.882732 run iperf3-srv_10.42.42.10(pid=4366): Launched 10:01:34.007260 tst cs_paging_gprs_active.py:38: start network... 10:01:34.231338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:34.746365 run create_hlr_db(pid=4367): Launched 10:01:34.879960 bus /gobi_6: Setting Powered False 10:01:35.944457 run create_hlr_db(pid=4367): Terminated: ok {rc=0} 10:01:36.406503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4369): Launched 10:01:36.738413 run osmo-hlr_10.42.42.2(pid=4370): Launched 10:01:36.865684 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:37.435472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4372): Launched 10:01:37.767550 run osmo-stp_10.42.42.5(pid=4373): Launched 10:01:37.894532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:01:38.466615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4375): Launched 10:01:38.593168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:01:38.874016 run patchelf(pid=4376): Launched 10:01:39.048079 run osmo-stp_10.42.42.5(pid=4373): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4373)] 10:01:39.181417 run osmo-stp_10.42.42.5(pid=4373): stdout: | (launched: 2022-12-14_10:01:37.705797) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:39.315429 run osmo-stp_10.42.42.5(pid=4373): stderr: | 20221214100137903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100137904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100137904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100137904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100137905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100137905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100137905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:39.450148 run osmo-stp_10.42.42.5(pid=4373): stdout: | (launched: 2022-12-14_10:01:37.705797) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:39.578345 run osmo-stp_10.42.42.5(pid=4373): stderr: | 20221214100137903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100137904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100137904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100137904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100137905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100137905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100137905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:39.729700 run patchelf(pid=4376): Terminating (SIGINT) 10:01:39.906046 run patchelf(pid=4376): Terminated: ok {rc=0} 10:01:40.033481 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4373): Process ended prematurely: osmo-stp_10.42.42.5(pid=4373) [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4373)] [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:01:40.043366 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 10:01:40.070981 run osmo-hlr_10.42.42.2(pid=4370): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4370)] 10:01:40.120691 run osmo-hlr_10.42.42.2(pid=4370): stdout: | (launched: 2022-12-14_10:01:36.675820) 10:01:40.171224 run osmo-hlr_10.42.42.2(pid=4370): stderr: | 20221214100136880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100136880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100136880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100136880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100136880 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100136880 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100136893 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100136901 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100136901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100136901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:40.222094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4363): Terminating (SIGTERM) 10:01:40.262736 run iperf3-srv_10.42.42.10(pid=4364): Terminating (SIGTERM) 10:01:40.303297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4365): Terminating (SIGTERM) 10:01:40.344070 run iperf3-srv_10.42.42.10(pid=4366): Terminating (SIGTERM) 10:01:40.384634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4369): Terminating (SIGTERM) 10:01:40.425320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4372): Terminating (SIGTERM) 10:01:40.466451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4375): Terminating (SIGTERM) 10:01:40.507293 --- ParallelTerminationStrategy: PID 4363 died... 10:01:40.527075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4363): Terminated: ok {rc=0} 10:01:40.572144 --- ParallelTerminationStrategy: PID 4364 died... 10:01:40.591612 run iperf3-srv_10.42.42.10(pid=4364): Terminated {rc=256} 10:01:40.636588 --- ParallelTerminationStrategy: PID 4365 died... 10:01:40.656051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4365): Terminated: ok {rc=0} 10:01:40.700740 --- ParallelTerminationStrategy: PID 4366 died... 10:01:40.720431 run iperf3-srv_10.42.42.10(pid=4366): Terminated {rc=256} 10:01:40.765160 --- ParallelTerminationStrategy: PID 4369 died... 10:01:40.784076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4369): Terminated: ok {rc=0} 10:01:40.828475 --- ParallelTerminationStrategy: PID 4372 died... 10:01:40.847545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4372): Terminated: ok {rc=0} 10:01:40.891961 --- ParallelTerminationStrategy: PID 4375 died... 10:01:40.910975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4375): Terminated: ok {rc=0} 10:01:40.998317 bus /gobi_0: Setting Powered False 10:01:42.098099 bus /gobi_0: Setting Powered False 10:01:43.210410 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:01:44.360736 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:44.372846 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:01:44.434595 tst iperf3.py: using LAC 40154 10:01:44.558341 tst iperf3.py: using RAC 119 10:01:44.688616 tst iperf3.py: using CellId 40154 10:01:44.818459 tst iperf3.py: using BVCI 40155 10:01:44.940144 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:44.951755 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:44.963207 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:44.974616 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:44.985853 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:44.997152 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:45.008560 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:45.019913 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:45.031484 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:01:45.149546 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:01:45.358798 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:01:45.673539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4377): Launched 10:01:45.997640 run iperf3-srv_10.42.42.10(pid=4378): Launched 10:01:46.134195 tst iperf3.py:8: start network... 10:01:46.365515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:46.898145 run create_hlr_db(pid=4379): Launched 10:01:47.063649 bus /gobi_6: Setting Powered False 10:01:48.128287 run create_hlr_db(pid=4379): Terminated: ok {rc=0} 10:01:48.590899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4381): Launched 10:01:48.922999 run osmo-hlr_10.42.42.2(pid=4382): Launched 10:01:49.048042 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:49.618345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4384): Launched 10:01:49.949966 run osmo-stp_10.42.42.5(pid=4385): Launched 10:01:50.075210 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:01:50.648027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4387): Launched 10:01:50.774597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:01:51.056652 run patchelf(pid=4388): Launched 10:01:51.240726 run osmo-stp_10.42.42.5(pid=4385): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4385)] 10:01:51.379919 run osmo-stp_10.42.42.5(pid=4385): stdout: | (launched: 2022-12-14_10:01:49.887334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:51.520626 run osmo-stp_10.42.42.5(pid=4385): stderr: | 20221214100150086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100150086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100150086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100150086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100150087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100150087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100150087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:51.661395 run osmo-stp_10.42.42.5(pid=4385): stdout: | (launched: 2022-12-14_10:01:49.887334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:51.796013 run osmo-stp_10.42.42.5(pid=4385): stderr: | 20221214100150086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100150086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100150086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100150086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100150087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100150087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100150087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:51.956241 run patchelf(pid=4388): Terminating (SIGINT) 10:01:52.141937 run patchelf(pid=4388): Terminated: ok {rc=0} 10:01:52.278444 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4385): Process ended prematurely: osmo-stp_10.42.42.5(pid=4385) [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4385)] [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 10:01:52.289297 tst iperf3.py:8: Test FAILED (8.0 sec) 10:01:52.317895 run osmo-hlr_10.42.42.2(pid=4382): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4382)] 10:01:52.368482 run osmo-hlr_10.42.42.2(pid=4382): stdout: | (launched: 2022-12-14_10:01:48.860414) 10:01:52.420915 run osmo-hlr_10.42.42.2(pid=4382): stderr: | 20221214100149062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100149062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100149062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100149062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100149062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100149062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100149074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100149082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100149082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100149082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:52.473764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4377): Terminating (SIGTERM) 10:01:52.515714 run iperf3-srv_10.42.42.10(pid=4378): Terminating (SIGTERM) 10:01:52.558175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4381): Terminating (SIGTERM) 10:01:52.600330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4384): Terminating (SIGTERM) 10:01:52.642423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4387): Terminating (SIGTERM) 10:01:52.684876 --- ParallelTerminationStrategy: PID 4377 died... 10:01:52.705059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4377): Terminated: ok {rc=0} 10:01:52.751623 --- ParallelTerminationStrategy: PID 4378 died... 10:01:52.771431 run iperf3-srv_10.42.42.10(pid=4378): Terminated {rc=256} 10:01:52.817527 --- ParallelTerminationStrategy: PID 4381 died... 10:01:52.837331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4381): Terminated: ok {rc=0} 10:01:52.883902 --- ParallelTerminationStrategy: PID 4384 died... 10:01:52.903580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4384): Terminated: ok {rc=0} 10:01:52.950047 --- ParallelTerminationStrategy: PID 4387 died... 10:01:52.969693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4387): Terminated: ok {rc=0} 10:01:53.058082 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:01:54.210309 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:54.222547 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:01:54.283808 tst iperf3m4.py: using LAC 40155 10:01:54.407126 tst iperf3m4.py: using RAC 120 10:01:54.530452 tst iperf3m4.py: using CellId 40155 10:01:54.653506 tst iperf3m4.py: using BVCI 40156 10:01:54.768314 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:54.779435 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:54.790238 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:54.801037 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:54.811913 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:54.822974 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:54.834460 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:54.845452 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:01:54.856433 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:01:54.978228 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:01:55.099982 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:01:55.221766 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:01:55.340659 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:01:55.549497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:01:55.862382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4389): Launched 10:01:56.134640 run iperf3-srv_10.42.42.10(pid=4390): Launched 10:01:56.250739 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:01:56.458515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:01:56.771518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4391): Launched 10:01:57.043343 run iperf3-srv_10.42.42.10(pid=4392): Launched 10:01:57.159502 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:01:57.366326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:01:57.680419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4393): Launched 10:01:57.952210 run iperf3-srv_10.42.42.10(pid=4394): Launched 10:01:58.068363 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:01:58.274966 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:01:58.587900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4395): Launched 10:01:58.860321 run iperf3-srv_10.42.42.10(pid=4396): Launched 10:01:58.976350 tst iperf3m4.py:8: start network... 10:01:59.183331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:59.663159 run create_hlr_db(pid=4397): Launched 10:01:59.780508 bus /gobi_6: Setting Powered False 10:02:00.851733 run create_hlr_db(pid=4397): Terminated: ok {rc=0} 10:02:01.299024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4399): Launched 10:02:01.628653 run osmo-hlr_10.42.42.2(pid=4400): Launched 10:02:01.819271 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:02.520291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4402): Launched 10:02:02.834568 run osmo-stp_10.42.42.5(pid=4403): Launched 10:02:02.952906 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:02:03.492550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4405): Launched 10:02:03.612204 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:02:03.878304 run patchelf(pid=4406): Launched 10:02:04.052646 run osmo-stp_10.42.42.5(pid=4403): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4403)] 10:02:04.184483 run osmo-stp_10.42.42.5(pid=4403): stdout: | (launched: 2022-12-14_10:02:02.775417) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:04.317623 run osmo-stp_10.42.42.5(pid=4403): stderr: | 20221214100202950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100202950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100202951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100202951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100202951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100202951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100202952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:04.451577 run osmo-stp_10.42.42.5(pid=4403): stdout: | (launched: 2022-12-14_10:02:02.775417) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:04.579199 run osmo-stp_10.42.42.5(pid=4403): stderr: | 20221214100202950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100202950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100202951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100202951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100202951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100202951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100202952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:04.730185 run patchelf(pid=4406): Terminating (SIGINT) 10:02:04.905694 run patchelf(pid=4406): Terminated: ok {rc=0} 10:02:05.032649 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4403): Process ended prematurely: osmo-stp_10.42.42.5(pid=4403) [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4403)] [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:02:05.042454 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:02:05.070179 run osmo-hlr_10.42.42.2(pid=4400): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4400)] 10:02:05.119161 run osmo-hlr_10.42.42.2(pid=4400): stdout: | (launched: 2022-12-14_10:02:01.565839) 10:02:05.169719 run osmo-hlr_10.42.42.2(pid=4400): stderr: | 20221214100201963 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100201963 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100201963 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100201963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100201963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100201963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100201979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100202000 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100202000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100202000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:05.220207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4389): Terminating (SIGTERM) 10:02:05.261043 run iperf3-srv_10.42.42.10(pid=4390): Terminating (SIGTERM) 10:02:05.301498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4391): Terminating (SIGTERM) 10:02:05.342227 run iperf3-srv_10.42.42.10(pid=4392): Terminating (SIGTERM) 10:02:05.382627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4393): Terminating (SIGTERM) 10:02:05.423856 run iperf3-srv_10.42.42.10(pid=4394): Terminating (SIGTERM) 10:02:05.464842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4395): Terminating (SIGTERM) 10:02:05.505898 run iperf3-srv_10.42.42.10(pid=4396): Terminating (SIGTERM) 10:02:05.546817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4399): Terminating (SIGTERM) 10:02:05.587994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4402): Terminating (SIGTERM) 10:02:05.628896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4405): Terminating (SIGTERM) 10:02:05.669646 --- ParallelTerminationStrategy: PID 4389 died... 10:02:05.689241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4389): Terminated: ok {rc=0} 10:02:05.734188 --- ParallelTerminationStrategy: PID 4390 died... 10:02:05.753471 run iperf3-srv_10.42.42.10(pid=4390): Terminated {rc=256} 10:02:05.798092 --- ParallelTerminationStrategy: PID 4391 died... 10:02:05.817334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4391): Terminated: ok {rc=0} 10:02:05.862035 --- ParallelTerminationStrategy: PID 4392 died... 10:02:05.881362 run iperf3-srv_10.42.42.10(pid=4392): Terminated {rc=256} 10:02:05.925983 --- ParallelTerminationStrategy: PID 4393 died... 10:02:05.945226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4393): Terminated: ok {rc=0} 10:02:05.989877 --- ParallelTerminationStrategy: PID 4394 died... 10:02:06.009498 run iperf3-srv_10.42.42.10(pid=4394): Terminated {rc=256} 10:02:06.054152 --- ParallelTerminationStrategy: PID 4395 died... 10:02:06.073317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4395): Terminated: ok {rc=0} 10:02:06.117832 --- ParallelTerminationStrategy: PID 4396 died... 10:02:06.137238 run iperf3-srv_10.42.42.10(pid=4396): Terminated {rc=256} 10:02:06.181781 --- ParallelTerminationStrategy: PID 4399 died... 10:02:06.200940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4399): Terminated: ok {rc=0} 10:02:06.245443 --- ParallelTerminationStrategy: PID 4402 died... 10:02:06.264591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4402): Terminated: ok {rc=0} 10:02:06.309107 --- ParallelTerminationStrategy: PID 4405 died... 10:02:06.328164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4405): Terminated: ok {rc=0} 10:02:06.415337 bus /gobi_4: Setting Powered False 10:02:07.515571 bus /gobi_4: Setting Powered False 10:02:08.633002 bus /gobi_1: Setting Powered False 10:02:09.734076 bus /gobi_1: Setting Powered False 10:02:10.852110 bus /gobi_0: Setting Powered False 10:02:11.954217 bus /gobi_0: Setting Powered False 10:02:13.073527 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:02:14.178385 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:14.190585 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:02:14.250545 tst ping.py: using LAC 40156 10:02:14.382542 tst ping.py: using RAC 121 10:02:14.509455 tst ping.py: using CellId 40156 10:02:14.637514 tst ping.py: using BVCI 40157 10:02:14.755432 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:14.766971 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:14.778296 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:14.789519 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:14.800600 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:14.811905 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:14.823221 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:14.834422 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:02:14.951729 tst ping.py:19: start network... 10:02:15.157455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:15.631724 run create_hlr_db(pid=4408): Launched 10:02:15.748413 bus /gobi_6: Setting Powered False 10:02:16.839017 run create_hlr_db(pid=4408): Terminated: ok {rc=0} 10:02:17.332730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4410): Launched 10:02:17.660259 run osmo-hlr_10.42.42.2(pid=4411): Launched 10:02:17.784696 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:18.351553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4413): Launched 10:02:18.679064 run osmo-stp_10.42.42.5(pid=4414): Launched 10:02:18.803301 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:02:19.366656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4416): Launched 10:02:19.490038 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:02:19.764665 run patchelf(pid=4417): Launched 10:02:19.945144 run osmo-stp_10.42.42.5(pid=4414): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4414)] 10:02:20.081976 run osmo-stp_10.42.42.5(pid=4414): stdout: | (launched: 2022-12-14_10:02:18.617651) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:20.220504 run osmo-stp_10.42.42.5(pid=4414): stderr: | 20221214100218810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100218810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100218811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100218811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100218811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100218812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100218812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:20.359805 run osmo-stp_10.42.42.5(pid=4414): stdout: | (launched: 2022-12-14_10:02:18.617651) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:20.492430 run osmo-stp_10.42.42.5(pid=4414): stderr: | 20221214100218810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100218810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100218811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100218811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100218811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100218812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100218812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:20.649746 run patchelf(pid=4417): Terminating (SIGINT) 10:02:20.831767 run patchelf(pid=4417): Terminated: ok {rc=0} 10:02:20.963836 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4414): Process ended prematurely: osmo-stp_10.42.42.5(pid=4414) [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4414)] [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 10:02:20.973610 tst ping.py:22: Test FAILED (6.8 sec) 10:02:21.002096 run osmo-hlr_10.42.42.2(pid=4411): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4411)] 10:02:21.053202 run osmo-hlr_10.42.42.2(pid=4411): stdout: | (launched: 2022-12-14_10:02:17.599008) 10:02:21.105826 run osmo-hlr_10.42.42.2(pid=4411): stderr: | 20221214100217800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100217800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100217800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100217800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100217801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100217801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100217812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100217820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100217821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100217821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:21.158862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4410): Terminating (SIGTERM) 10:02:21.201309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4413): Terminating (SIGTERM) 10:02:21.244097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4416): Terminating (SIGTERM) 10:02:21.286639 --- ParallelTerminationStrategy: PID 4410 died... 10:02:21.306857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4410): Terminated: ok {rc=0} 10:02:21.353575 --- ParallelTerminationStrategy: PID 4413 died... 10:02:21.373373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4413): Terminated: ok {rc=0} 10:02:21.419721 --- ParallelTerminationStrategy: PID 4416 died... 10:02:21.439456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4416): Terminated: ok {rc=0} 10:02:21.527318 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:02:22.616591 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:22.628727 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:02:22.688406 tst ping_idle_ping.py: using LAC 40157 10:02:22.809400 tst ping_idle_ping.py: using RAC 122 10:02:22.933319 tst ping_idle_ping.py: using CellId 40157 10:02:23.052906 tst ping_idle_ping.py: using BVCI 40158 10:02:23.163750 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:23.174911 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:23.185840 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:23.196697 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:23.207685 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:23.218907 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:23.230376 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:02:23.241565 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:02:23.361117 tst ping_idle_ping.py:24: start network... 10:02:23.581284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:24.091321 run create_hlr_db(pid=4418): Launched 10:02:24.223402 bus /gobi_6: Setting Powered False 10:02:25.287377 run create_hlr_db(pid=4418): Terminated: ok {rc=0} 10:02:25.726212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4420): Launched 10:02:26.034604 run osmo-hlr_10.42.42.2(pid=4421): Launched 10:02:26.151303 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:26.696044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4423): Launched 10:02:27.003690 run osmo-stp_10.42.42.5(pid=4424): Launched 10:02:27.120423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:02:27.650893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4426): Launched 10:02:27.768060 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:02:28.028352 run patchelf(pid=4427): Launched 10:02:28.198407 run osmo-stp_10.42.42.5(pid=4424): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4424)] 10:02:28.327755 run osmo-stp_10.42.42.5(pid=4424): stdout: | (launched: 2022-12-14_10:02:26.945814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:28.459321 run osmo-stp_10.42.42.5(pid=4424): stderr: | 20221214100227118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100227118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100227118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100227119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100227119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100227119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100227119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:28.591688 run osmo-stp_10.42.42.5(pid=4424): stdout: | (launched: 2022-12-14_10:02:26.945814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:28.716704 run osmo-stp_10.42.42.5(pid=4424): stderr: | 20221214100227118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100227118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100227118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100227119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100227119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100227119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100227119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:28.865319 run patchelf(pid=4427): Terminating (SIGINT) 10:02:29.038070 run patchelf(pid=4427): Terminated: ok {rc=0} 10:02:29.163028 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4424): Process ended prematurely: osmo-stp_10.42.42.5(pid=4424) [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4424)] [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:02:29.171996 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:02:29.199014 run osmo-hlr_10.42.42.2(pid=4421): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4421)] 10:02:29.247717 run osmo-hlr_10.42.42.2(pid=4421): stdout: | (launched: 2022-12-14_10:02:25.976168) 10:02:29.297980 run osmo-hlr_10.42.42.2(pid=4421): stderr: | 20221214100226154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100226154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100226154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100226154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100226154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100226154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100226166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100226175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100226175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100226175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:29.348714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4420): Terminating (SIGTERM) 10:02:29.389105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4423): Terminating (SIGTERM) 10:02:29.429358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4426): Terminating (SIGTERM) 10:02:29.469916 --- ParallelTerminationStrategy: PID 4420 died... 10:02:29.489442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4420): Terminated: ok {rc=0} 10:02:29.533739 --- ParallelTerminationStrategy: PID 4423 died... 10:02:29.552894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4423): Terminated: ok {rc=0} 10:02:29.597340 --- ParallelTerminationStrategy: PID 4426 died... 10:02:29.616434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4426): Terminated: ok {rc=0} 10:02:29.700850 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:02:31.034907 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:02:31.049474 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:02:31.100591 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:02:31.148184 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:02:31.216857 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:02:31.250069 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:02:31.305485 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:02:31.861017 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:02:31.868436 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:02:31.883969 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:02:31.954586 tst switch_tch_pdch.py: using LAC 40158 10:02:32.111000 tst switch_tch_pdch.py: using RAC 123 10:02:32.255002 tst switch_tch_pdch.py: using CellId 40158 10:02:32.389365 tst switch_tch_pdch.py: using BVCI 40159 10:02:32.500190 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:02:32.511547 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:02:32.522821 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:02:32.534002 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:02:32.545939 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:02:32.557888 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:02:32.570042 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:02:32.581944 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:02:32.705366 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:02:32.826085 tst switch_tch_pdch.py:51: start network... 10:02:33.045357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:33.549186 run create_hlr_db(pid=4431): Launched 10:02:33.683437 bus /gobi_6: Setting Powered False 10:02:34.748032 run create_hlr_db(pid=4431): Terminated: ok {rc=0} 10:02:35.185287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4433): Launched 10:02:35.500172 run osmo-hlr_10.42.42.2(pid=4434): Launched 10:02:35.613122 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:36.122251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4436): Launched 10:02:36.419057 run osmo-stp_10.42.42.5(pid=4437): Launched 10:02:36.532442 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:02:37.061626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4440): Launched 10:02:37.175404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:02:37.426226 run patchelf(pid=4441): Launched 10:02:37.590590 run osmo-stp_10.42.42.5(pid=4437): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4437)] 10:02:37.716330 run osmo-stp_10.42.42.5(pid=4437): stdout: | (launched: 2022-12-14_10:02:36.363094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:37.844045 run osmo-stp_10.42.42.5(pid=4437): stderr: | 20221214100236535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100236535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100236536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100236536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100236537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100236537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100236537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:37.971679 run osmo-stp_10.42.42.5(pid=4437): stdout: | (launched: 2022-12-14_10:02:36.363094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:38.092675 run osmo-stp_10.42.42.5(pid=4437): stderr: | 20221214100236535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100236535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100236536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100236536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100236537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100236537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100236537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:38.236386 run patchelf(pid=4441): Terminating (SIGINT) 10:02:38.404526 run patchelf(pid=4441): Terminated: ok {rc=0} 10:02:38.526173 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4437): Process ended prematurely: osmo-stp_10.42.42.5(pid=4437) [trial-2403↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4437)] [trial-2403↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:02:38.535073 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 10:02:38.561808 run osmo-hlr_10.42.42.2(pid=4434): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4434)] 10:02:38.609973 run osmo-hlr_10.42.42.2(pid=4434): stdout: | (launched: 2022-12-14_10:02:35.442100) 10:02:38.659930 run osmo-hlr_10.42.42.2(pid=4434): stderr: | 20221214100235620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100235620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100235620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100235620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100235620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100235621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100235633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100235641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100235642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100235642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:38.709955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4433): Terminating (SIGTERM) 10:02:38.749987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4436): Terminating (SIGTERM) 10:02:38.789843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4440): Terminating (SIGTERM) 10:02:38.830015 --- ParallelTerminationStrategy: PID 4433 died... 10:02:38.849536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4433): Terminated: ok {rc=0} 10:02:38.893877 --- ParallelTerminationStrategy: PID 4436 died... 10:02:38.912857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4436): Terminated: ok {rc=0} 10:02:38.957205 --- ParallelTerminationStrategy: PID 4440 died... 10:02:38.976090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4440): Terminated: ok {rc=0} 10:02:39.062497 bus /gobi_0: Setting Powered False 10:02:40.164323 bus /gobi_0: Setting Powered False 10:02:41.281729 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:02:42.519911 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:02:42.526651 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:02:42.547883 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:02:42.583225 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:02:42.639256 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:02:42.660322 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:02:42.694922 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:02:43.246787 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:02:43.252159 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:02:43.263096 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:02:43.319029 tst switch_tch_pdch.py: using LAC 40159 10:02:43.434301 tst switch_tch_pdch.py: using RAC 124 10:02:43.551401 tst switch_tch_pdch.py: using CellId 40159 10:02:43.667255 tst switch_tch_pdch.py: using BVCI 40160 10:02:43.776746 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:02:43.787831 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:02:43.798805 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:02:43.809420 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:02:43.820257 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:02:43.831335 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:02:43.842635 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:02:43.853778 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:02:43.972623 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:02:44.090538 tst switch_tch_pdch.py:51: start network... 10:02:44.289227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:44.726179 run create_hlr_db(pid=4445): Launched 10:02:44.838315 bus /gobi_6: Setting Powered False 10:02:45.915227 run create_hlr_db(pid=4445): Terminated: ok {rc=0} 10:02:46.318423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4447): Launched 10:02:46.631967 run osmo-hlr_10.42.42.2(pid=4448): Launched 10:02:46.882199 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:47.385886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4450): Launched 10:02:47.700648 run osmo-stp_10.42.42.5(pid=4451): Launched 10:02:47.819131 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:02:48.333100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4453): Launched 10:02:48.452456 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:02:48.718359 run patchelf(pid=4454): Launched 10:02:48.892017 run osmo-stp_10.42.42.5(pid=4451): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4451)] 10:02:49.025308 run osmo-stp_10.42.42.5(pid=4451): stdout: | (launched: 2022-12-14_10:02:47.642043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:49.159927 run osmo-stp_10.42.42.5(pid=4451): stderr: | 20221214100247833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100247833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100247833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100247833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100247834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100247834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100247834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:49.295238 run osmo-stp_10.42.42.5(pid=4451): stdout: | (launched: 2022-12-14_10:02:47.642043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:49.423695 run osmo-stp_10.42.42.5(pid=4451): stderr: | 20221214100247833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100247833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100247833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100247833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100247834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100247834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100247834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:49.575621 run patchelf(pid=4454): Terminating (SIGINT) 10:02:49.752334 run patchelf(pid=4454): Terminated: ok {rc=0} 10:02:49.879662 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4451): Process ended prematurely: osmo-stp_10.42.42.5(pid=4451) [trial-2403↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4451)] [trial-2403↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:02:49.889366 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 10:02:49.917517 run osmo-hlr_10.42.42.2(pid=4448): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4448)] 10:02:49.967577 run osmo-hlr_10.42.42.2(pid=4448): stdout: | (launched: 2022-12-14_10:02:46.563445) 10:02:50.019423 run osmo-hlr_10.42.42.2(pid=4448): stderr: | 20221214100246818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100246818 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100246818 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100246818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100246818 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100246818 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100246838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100246846 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100246846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100246846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:50.071463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4447): Terminating (SIGTERM) 10:02:50.113292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4450): Terminating (SIGTERM) 10:02:50.155421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4453): Terminating (SIGTERM) 10:02:50.197476 --- ParallelTerminationStrategy: PID 4447 died... 10:02:50.217291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4447): Terminated: ok {rc=0} 10:02:50.263385 --- ParallelTerminationStrategy: PID 4450 died... 10:02:50.282900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4450): Terminated: ok {rc=0} 10:02:50.328494 --- ParallelTerminationStrategy: PID 4453 died... 10:02:50.347868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4453): Terminated: ok {rc=0} 10:02:50.433792 bus /gobi_0: Setting Powered False 10:02:51.531219 bus /gobi_0: Setting Powered False 10:02:52.646893 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_sms:oc2g --------------------------------------------------------------------- 10:02:53.886767 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:02:53.890679 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 10:02:53.911826 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 10:02:53.918786 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 10:02:53.972698 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 10:02:53.993969 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 10:02:54.000690 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 10:02:54.537677 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 10:02:54.542927 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 10:02:54.554074 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 10:02:54.591177 tst mo_mt_sms.py: using LAC 40160 10:02:54.705733 tst mo_mt_sms.py: using RAC 125 10:02:54.828126 tst mo_mt_sms.py: using CellId 40160 10:02:54.949805 tst mo_mt_sms.py: using BVCI 40161 10:02:55.062943 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 10:02:55.175940 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 10:02:55.289394 tst mo_mt_sms.py:9: start nitb and bts... 10:02:55.484824 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:02:56.081822 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4459): Launched 10:02:56.376436 run osmo-nitb_10.42.42.2(pid=4460): Launched 10:02:56.538295 run osmo-nitb_10.42.42.2(pid=4460): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4460)] 10:02:56.670065 run osmo-nitb_10.42.42.2(pid=4460): stdout: | (launched: 2022-12-14_10:02:56.321395) 10:02:56.803807 run osmo-nitb_10.42.42.2(pid=4460): stderr: | (launched: 2022-12-14_10:02:56.364738) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:02:56.937567 run osmo-nitb_10.42.42.2(pid=4460): stdout: | (launched: 2022-12-14_10:02:56.321395) 10:02:57.065225 run osmo-nitb_10.42.42.2(pid=4460): stderr: | (launched: 2022-12-14_10:02:56.364738) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4460): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4460) [trial-2403↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4460)] 10:02:57.486076 tst osmo-nitb_10.42.42.2(pid=4460): stdout: | (launched: 2022-12-14_10:02:56.321395) 10:02:57.604329 tst osmo-nitb_10.42.42.2(pid=4460): stderr: | (launched: 2022-12-14_10:02:56.364738) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:02:57.743433 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4460): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4460) [trial-2403↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4460)] [trial-2403↪nitb_sms:oc2g↪mo_mt_sms.py:11] 10:02:57.751710 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 10:02:57.758204 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4459): Terminating (SIGTERM) 10:02:57.966882 --- ParallelTerminationStrategy: PID 4459 died... 10:02:57.987377 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4459): Terminated: ok {rc=0} 10:02:58.073676 bus /sierra_3: Setting Powered False 10:02:59.171913 bus /sierra_3: Setting Powered False 10:03:00.287782 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 sms:oc2g --------------------------------------------------------------------- 10:03:01.472889 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:03:01.478815 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 10:03:01.504208 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 10:03:01.538708 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 10:03:01.602570 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 10:03:01.629037 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 10:03:01.664464 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 10:03:02.190772 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 sms:oc2g mo_mt_sms.py ---------------------------------------------- 10:03:02.199909 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:03:02.215206 tst sms:oc2g: Using 1 x bts (candidates: 1) 10:03:02.253078 tst mo_mt_sms.py: using LAC 40161 10:03:02.375049 tst mo_mt_sms.py: using RAC 126 10:03:02.489355 tst mo_mt_sms.py: using CellId 40161 10:03:02.602720 tst mo_mt_sms.py: using BVCI 40162 10:03:02.708394 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:03:02.719032 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:03:02.729571 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:03:02.739961 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:03:02.751347 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 10:03:02.762711 tst sms:oc2g: Using 1 x modem (candidates: 2) 10:03:02.883434 tst sms:oc2g: Using 1 x modem (candidates: 2) 10:03:02.998756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:03.453254 run create_hlr_db(pid=4465): Launched 10:03:03.564254 bus /sierra_2: Setting Powered False 10:03:04.623269 run create_hlr_db(pid=4465): Terminated: ok {rc=0} 10:03:05.055321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4467): Launched 10:03:05.369556 run osmo-hlr_10.42.42.2(pid=4468): Launched 10:03:05.488704 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:06.029705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4470): Launched 10:03:06.345054 run osmo-stp_10.42.42.5(pid=4471): Launched 10:03:06.462953 run osmo-msc_10.42.42.6: Starting osmo-msc 10:03:07.027407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4473): Launched 10:03:07.338888 run osmo-msc_10.42.42.6(pid=4474): Launched 10:03:07.511181 run osmo-stp_10.42.42.5(pid=4471): ERR: Terminated: ERROR {rc=1} [trial-2403↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4471)] 10:03:07.646038 run osmo-stp_10.42.42.5(pid=4471): stdout: | (launched: 2022-12-14_10:03:06.286882) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:07.776929 run osmo-stp_10.42.42.5(pid=4471): stderr: | 20221214100306489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100306489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100306489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100306490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100306490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100306490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100306490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:07.906603 run osmo-stp_10.42.42.5(pid=4471): stdout: | (launched: 2022-12-14_10:03:06.286882) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:08.030422 run osmo-stp_10.42.42.5(pid=4471): stderr: | 20221214100306489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100306489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100306489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100306490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100306490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100306490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100306490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:08.178534 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=4471): Process ended prematurely: osmo-stp_10.42.42.5(pid=4471) [trial-2403↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4471)] [trial-2403↪sms:oc2g↪mo_mt_sms.py:16] 10:03:08.187424 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 10:03:08.214632 run osmo-hlr_10.42.42.2(pid=4468): ERR: Terminated: ERROR {rc=237} [trial-2403↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4468)] 10:03:08.264521 run osmo-hlr_10.42.42.2(pid=4468): stdout: | (launched: 2022-12-14_10:03:05.310923) 10:03:08.316112 run osmo-hlr_10.42.42.2(pid=4468): stderr: | 20221214100305512 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100305512 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100305512 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100305512 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100305512 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100305512 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100305545 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100305556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100305557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100305557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:08.387894 run osmo-msc_10.42.42.6(pid=4474): ERR: Terminated: ERROR {rc=2} [trial-2403↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4474)] 10:03:08.437237 run osmo-msc_10.42.42.6(pid=4474): stdout: | (launched: 2022-12-14_10:03:07.280574) 10:03:08.488489 run osmo-msc_10.42.42.6(pid=4474): stderr: | 20221214100307602 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100307602 DLGLOBAL DEBUG validating counter group 0x7fafca77bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100307602 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100307602 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100307602 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100307602 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100307604 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100307605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100307605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100307605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:03:08.539922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4467): Terminating (SIGTERM) 10:03:08.581230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4470): Terminating (SIGTERM) 10:03:08.622724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4473): Terminating (SIGTERM) 10:03:08.664424 --- ParallelTerminationStrategy: PID 4467 died... 10:03:08.684378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4467): Terminated: ok {rc=0} 10:03:08.730127 --- ParallelTerminationStrategy: PID 4470 died... 10:03:08.749717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4470): Terminated: ok {rc=0} 10:03:08.795383 --- ParallelTerminationStrategy: PID 4473 died... 10:03:08.814971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4473): Terminated: ok {rc=0} 10:03:08.901152 bus /sierra_3: Setting Powered False 10:03:09.997155 bus /sierra_3: Setting Powered False 10:03:11.112941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_ussd:oc2g --------------------------------------------------------------------- 10:03:12.326534 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:03:12.330226 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 10:03:12.350337 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 10:03:12.357189 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 10:03:12.391192 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 10:03:12.412273 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 10:03:12.419032 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 10:03:12.939267 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2403 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 10:03:12.944301 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 10:03:12.955014 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 10:03:12.988787 tst assert_extension.py: using LAC 40162 10:03:13.110607 tst assert_extension.py: using RAC 127 10:03:13.232029 tst assert_extension.py: using CellId 40162 10:03:13.353198 tst assert_extension.py: using BVCI 40163 10:03:13.466189 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 10:03:13.581904 tst assert_extension.py:10: start nitb and bts... 10:03:13.779179 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:03:14.377444 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4479): Launched 10:03:14.672157 run osmo-nitb_10.42.42.2(pid=4480): Launched 10:03:14.835819 run osmo-nitb_10.42.42.2(pid=4480): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4480)] 10:03:14.969244 run osmo-nitb_10.42.42.2(pid=4480): stdout: | (launched: 2022-12-14_10:03:14.617235) 10:03:15.103265 run osmo-nitb_10.42.42.2(pid=4480): stderr: | (launched: 2022-12-14_10:03:14.660285) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:03:15.237244 run osmo-nitb_10.42.42.2(pid=4480): stdout: | (launched: 2022-12-14_10:03:14.617235) 10:03:15.365643 run osmo-nitb_10.42.42.2(pid=4480): stderr: | (launched: 2022-12-14_10:03:14.660285) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4480): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4480) [trial-2403↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4480)] 10:03:15.783579 tst osmo-nitb_10.42.42.2(pid=4480): stdout: | (launched: 2022-12-14_10:03:14.617235) 10:03:15.905107 tst osmo-nitb_10.42.42.2(pid=4480): stderr: | (launched: 2022-12-14_10:03:14.660285) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:03:16.047628 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=4480): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4480) [trial-2403↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4480)] [trial-2403↪nitb_ussd:oc2g↪assert_extension.py:12] 10:03:16.056500 tst assert_extension.py:12: Test FAILED (3.1 sec) 10:03:16.063701 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4479): Terminating (SIGTERM) 10:03:16.274605 --- ParallelTerminationStrategy: PID 4479 died... 10:03:16.298399 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4479): Terminated: ok {rc=0} 10:03:16.436366 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 ussd:oc2g --------------------------------------------------------------------- 10:03:17.661138 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:03:17.666465 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 10:03:17.687520 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 10:03:17.715557 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 10:03:17.750295 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 10:03:17.772234 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 10:03:17.799916 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 10:03:18.326754 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2403 ussd:oc2g assert_extension.py ---------------------------------------------- 10:03:18.332800 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:03:18.344317 tst ussd:oc2g: Using 1 x bts (candidates: 1) 10:03:18.383866 tst assert_extension.py: using LAC 40163 10:03:18.506034 tst assert_extension.py: using RAC 128 10:03:18.626395 tst assert_extension.py: using CellId 40163 10:03:18.747100 tst assert_extension.py: using BVCI 40164 10:03:18.858859 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:03:18.869693 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:03:18.880413 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:03:18.891112 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:03:18.901852 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 10:03:18.913037 tst ussd:oc2g: Using 1 x modem (candidates: 1) 10:03:19.026882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:19.473725 run create_hlr_db(pid=4484): Launched 10:03:19.585513 bus /sierra_2: Setting Powered False 10:03:20.643892 run create_hlr_db(pid=4484): Terminated: ok {rc=0} 10:03:21.050212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4486): Launched 10:03:21.340389 run osmo-hlr_10.42.42.2(pid=4487): Launched 10:03:21.451099 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:21.969300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4489): Launched 10:03:22.260918 run osmo-stp_10.42.42.5(pid=4490): Launched 10:03:22.371620 run osmo-msc_10.42.42.6: Starting osmo-msc 10:03:22.894445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4492): Launched 10:03:23.185451 run osmo-msc_10.42.42.6(pid=4493): Launched 10:03:23.351620 run osmo-stp_10.42.42.5(pid=4490): ERR: Terminated: ERROR {rc=1} [trial-2403↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4490)] 10:03:23.476729 run osmo-stp_10.42.42.5(pid=4490): stdout: | (launched: 2022-12-14_10:03:22.206611) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:23.602022 run osmo-stp_10.42.42.5(pid=4490): stderr: | 20221214100322371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100322371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100322371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100322372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100322372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100322372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100322373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:23.725773 run osmo-stp_10.42.42.5(pid=4490): stdout: | (launched: 2022-12-14_10:03:22.206611) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:23.843702 run osmo-stp_10.42.42.5(pid=4490): stderr: | 20221214100322371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100322371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100322371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100322372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100322372 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100322372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100322373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:23.985382 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=4490): Process ended prematurely: osmo-stp_10.42.42.5(pid=4490) [trial-2403↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4490)] [trial-2403↪ussd:oc2g↪assert_extension.py:17] 10:03:23.993655 tst assert_extension.py:17: Test FAILED (5.7 sec) 10:03:24.019711 run osmo-hlr_10.42.42.2(pid=4487): ERR: Terminated: ERROR {rc=237} [trial-2403↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4487)] 10:03:24.068049 run osmo-hlr_10.42.42.2(pid=4487): stdout: | (launched: 2022-12-14_10:03:21.287322) 10:03:24.117609 run osmo-hlr_10.42.42.2(pid=4487): stderr: | 20221214100321456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100321456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100321456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100321456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100321456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100321457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100321471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100321482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100321482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100321482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:24.186858 run osmo-msc_10.42.42.6(pid=4493): ERR: Terminated: ERROR {rc=2} [trial-2403↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4493)] 10:03:24.234267 run osmo-msc_10.42.42.6(pid=4493): stdout: | (launched: 2022-12-14_10:03:23.132046) 10:03:24.283494 run osmo-msc_10.42.42.6(pid=4493): stderr: | 20221214100323398 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100323399 DLGLOBAL DEBUG validating counter group 0x7f9b7ab76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100323399 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100323399 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100323399 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100323399 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100323401 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100323401 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100323402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100323402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:03:24.333249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4486): Terminating (SIGTERM) 10:03:24.373249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4489): Terminating (SIGTERM) 10:03:24.412933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4492): Terminating (SIGTERM) 10:03:24.452877 --- ParallelTerminationStrategy: PID 4486 died... 10:03:24.472260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4486): Terminated: ok {rc=0} 10:03:24.516144 --- ParallelTerminationStrategy: PID 4489 died... 10:03:24.534975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4489): Terminated: ok {rc=0} 10:03:24.578641 --- ParallelTerminationStrategy: PID 4492 died... 10:03:24.597849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4492): Terminated: ok {rc=0} 10:03:24.684184 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:03:25.884420 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:03:25.892551 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:03:25.913328 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:03:25.940593 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:03:25.989758 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:03:26.010014 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:03:26.036737 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:03:26.588012 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:03:26.638643 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:03:26.649760 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:03:26.704883 tst mo_mt_call.py: using LAC 40164 10:03:26.826074 tst mo_mt_call.py: using RAC 129 10:03:26.944525 tst mo_mt_call.py: using CellId 40164 10:03:27.062025 tst mo_mt_call.py: using BVCI 40165 10:03:27.171316 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:03:27.182518 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:03:27.193467 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:03:27.204224 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:03:27.215273 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:03:27.226642 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:03:27.343614 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:03:27.465137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:27.967548 run create_hlr_db(pid=4498): Launched 10:03:28.099163 bus /sierra_2: Setting Powered False 10:03:29.160848 run create_hlr_db(pid=4498): Terminated: ok {rc=0} 10:03:29.593725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4500): Launched 10:03:29.897578 run osmo-hlr_10.42.42.2(pid=4501): Launched 10:03:30.013902 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:30.550098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4503): Launched 10:03:30.868398 run osmo-stp_10.42.42.5(pid=4504): Launched 10:03:31.142981 run osmo-msc_10.42.42.6: Starting osmo-msc 10:03:31.709728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4506): Launched 10:03:32.102921 run osmo-msc_10.42.42.6(pid=4507): Launched 10:03:32.440275 run osmo-stp_10.42.42.5(pid=4504): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4504)] 10:03:32.570530 run osmo-stp_10.42.42.5(pid=4504): stdout: | (launched: 2022-12-14_10:03:30.798155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:32.699054 run osmo-stp_10.42.42.5(pid=4504): stderr: | 20221214100331006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100331006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100331006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100331006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100331007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100331007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100331007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:32.826024 run osmo-stp_10.42.42.5(pid=4504): stdout: | (launched: 2022-12-14_10:03:30.798155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:32.946946 run osmo-stp_10.42.42.5(pid=4504): stderr: | 20221214100331006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100331006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100331006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100331006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100331007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100331007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100331007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:33.092236 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4504): Process ended prematurely: osmo-stp_10.42.42.5(pid=4504) [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4504)] [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:03:33.101617 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:03:33.128511 run osmo-hlr_10.42.42.2(pid=4501): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4501)] 10:03:33.177521 run osmo-hlr_10.42.42.2(pid=4501): stdout: | (launched: 2022-12-14_10:03:29.842258) 10:03:33.228323 run osmo-hlr_10.42.42.2(pid=4501): stderr: | 20221214100330011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100330011 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100330011 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100330011 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100330012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100330012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100330024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100330032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100330032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100330032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:33.298450 run osmo-msc_10.42.42.6(pid=4507): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4507)] 10:03:33.355613 run osmo-msc_10.42.42.6(pid=4507): stdout: | (launched: 2022-12-14_10:03:32.035898) 10:03:33.405778 run osmo-msc_10.42.42.6(pid=4507): stderr: | 20221214100332463 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100332463 DLGLOBAL DEBUG validating counter group 0x7f70d77c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100332463 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100332463 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100332463 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100332464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100332465 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100332466 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100332466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100332466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:03:33.456219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4500): Terminating (SIGTERM) 10:03:33.496878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4503): Terminating (SIGTERM) 10:03:33.537306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4506): Terminating (SIGTERM) 10:03:33.578071 --- ParallelTerminationStrategy: PID 4500 died... 10:03:33.598010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4500): Terminated: ok {rc=0} 10:03:33.642968 --- ParallelTerminationStrategy: PID 4503 died... 10:03:33.662167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4503): Terminated: ok {rc=0} 10:03:33.706904 --- ParallelTerminationStrategy: PID 4506 died... 10:03:33.726294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4506): Terminated: ok {rc=0} 10:03:33.811828 bus /sierra_3: Setting Powered False 10:03:34.906253 bus /sierra_3: Setting Powered False 10:03:36.019379 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:03:37.168066 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:03:37.180123 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:03:37.238457 tst mo_mt_call_osmux.py: using LAC 40165 10:03:37.365616 tst mo_mt_call_osmux.py: using RAC 130 10:03:37.492703 tst mo_mt_call_osmux.py: using CellId 40165 10:03:37.618772 tst mo_mt_call_osmux.py: using BVCI 40166 10:03:37.737037 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:03:37.748447 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:03:37.759687 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:03:37.770908 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:03:37.782147 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:03:37.793447 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:03:37.911343 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:03:38.031756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:38.532528 run create_hlr_db(pid=4509): Launched 10:03:38.664135 bus /sierra_2: Setting Powered False 10:03:39.727872 run create_hlr_db(pid=4509): Terminated: ok {rc=0} 10:03:40.178546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4511): Launched 10:03:40.501631 run osmo-hlr_10.42.42.2(pid=4512): Launched 10:03:40.623998 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:41.185413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4514): Launched 10:03:41.508553 run osmo-stp_10.42.42.5(pid=4515): Launched 10:03:41.631827 run osmo-msc_10.42.42.6: Starting osmo-msc 10:03:42.214083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4517): Launched 10:03:42.535308 run osmo-msc_10.42.42.6(pid=4518): Launched 10:03:42.714580 run osmo-stp_10.42.42.5(pid=4515): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4515)] 10:03:42.849506 run osmo-stp_10.42.42.5(pid=4515): stdout: | (launched: 2022-12-14_10:03:41.449723) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:42.988462 run osmo-stp_10.42.42.5(pid=4515): stderr: | 20221214100341636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100341636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100341637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100341637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100341638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100341638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100341638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:43.122928 run osmo-stp_10.42.42.5(pid=4515): stdout: | (launched: 2022-12-14_10:03:41.449723) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:43.250954 run osmo-stp_10.42.42.5(pid=4515): stderr: | 20221214100341636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100341636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100341637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100341637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100341638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100341638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100341638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:43.403826 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4515): Process ended prematurely: osmo-stp_10.42.42.5(pid=4515) [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4515)] [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:03:43.413333 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:03:43.441190 run osmo-hlr_10.42.42.2(pid=4512): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4512)] 10:03:43.491002 run osmo-hlr_10.42.42.2(pid=4512): stdout: | (launched: 2022-12-14_10:03:40.442881) 10:03:43.542696 run osmo-hlr_10.42.42.2(pid=4512): stderr: | 20221214100340637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100340637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100340637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100340637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100340638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100340638 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100340650 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100340659 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100340659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100340659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:43.614948 run osmo-msc_10.42.42.6(pid=4518): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4518)] 10:03:43.664393 run osmo-msc_10.42.42.6(pid=4518): stdout: | (launched: 2022-12-14_10:03:42.476793) 10:03:43.715816 run osmo-msc_10.42.42.6(pid=4518): stderr: | 20221214100342793 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100342793 DLGLOBAL DEBUG validating counter group 0x7f015c427c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100342793 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100342793 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100342793 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100342794 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100342795 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100342796 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100342796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100342796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:03:43.767842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4511): Terminating (SIGTERM) 10:03:43.809282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4514): Terminating (SIGTERM) 10:03:43.851256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4517): Terminating (SIGTERM) 10:03:43.893049 --- ParallelTerminationStrategy: PID 4511 died... 10:03:43.913051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4511): Terminated: ok {rc=0} 10:03:43.959137 --- ParallelTerminationStrategy: PID 4514 died... 10:03:43.978574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4514): Terminated: ok {rc=0} 10:03:44.024048 --- ParallelTerminationStrategy: PID 4517 died... 10:03:44.043480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4517): Terminated: ok {rc=0} 10:03:44.130075 bus /sierra_3: Setting Powered False 10:03:45.228266 bus /sierra_3: Setting Powered False 10:03:46.340579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:03:47.570563 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:03:47.577228 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:03:47.597587 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:03:47.625229 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:03:47.676079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:03:47.696566 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:03:47.723551 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:03:48.271986 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:03:48.321457 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:03:48.332533 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:03:48.389205 tst mo_mt_call.py: using LAC 40166 10:03:48.509172 tst mo_mt_call.py: using RAC 131 10:03:48.627797 tst mo_mt_call.py: using CellId 40166 10:03:48.748365 tst mo_mt_call.py: using BVCI 40167 10:03:48.859931 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:03:48.871079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:03:48.882011 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:03:48.892781 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:03:48.904190 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:03:48.915534 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:03:49.036131 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:03:49.151745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:49.621431 run create_hlr_db(pid=4523): Launched 10:03:49.738390 bus /sierra_2: Setting Powered False 10:03:50.802265 run create_hlr_db(pid=4523): Terminated: ok {rc=0} 10:03:51.255045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4525): Launched 10:03:51.579707 run osmo-hlr_10.42.42.2(pid=4526): Launched 10:03:51.703920 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:52.259387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4528): Launched 10:03:52.581743 run osmo-stp_10.42.42.5(pid=4529): Launched 10:03:52.705474 run osmo-msc_10.42.42.6: Starting osmo-msc 10:03:53.288230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4531): Launched 10:03:53.611657 run osmo-msc_10.42.42.6(pid=4532): Launched 10:03:53.791512 run osmo-stp_10.42.42.5(pid=4529): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4529)] 10:03:53.927376 run osmo-stp_10.42.42.5(pid=4529): stdout: | (launched: 2022-12-14_10:03:52.523175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:54.064423 run osmo-stp_10.42.42.5(pid=4529): stderr: | 20221214100352711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100352711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100352712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100352712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100352712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100352713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100352713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:54.199323 run osmo-stp_10.42.42.5(pid=4529): stdout: | (launched: 2022-12-14_10:03:52.523175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:54.327468 run osmo-stp_10.42.42.5(pid=4529): stderr: | 20221214100352711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100352711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100352712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100352712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100352712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100352713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100352713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:54.481222 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4529): Process ended prematurely: osmo-stp_10.42.42.5(pid=4529) [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4529)] [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:03:54.490876 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:03:54.519072 run osmo-hlr_10.42.42.2(pid=4526): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4526)] 10:03:54.569937 run osmo-hlr_10.42.42.2(pid=4526): stdout: | (launched: 2022-12-14_10:03:51.520645) 10:03:54.622202 run osmo-hlr_10.42.42.2(pid=4526): stderr: | 20221214100351714 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100351714 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100351714 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100351714 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100351714 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100351714 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100351727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100351735 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100351736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100351736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:54.695271 run osmo-msc_10.42.42.6(pid=4532): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4532)] 10:03:54.745607 run osmo-msc_10.42.42.6(pid=4532): stdout: | (launched: 2022-12-14_10:03:53.552694) 10:03:54.797760 run osmo-msc_10.42.42.6(pid=4532): stderr: | 20221214100353871 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100353871 DLGLOBAL DEBUG validating counter group 0x7fe7ebc89c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100353871 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100353871 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100353871 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100353872 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100353873 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100353874 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100353874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100353874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:03:54.850311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4525): Terminating (SIGTERM) 10:03:54.892413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4528): Terminating (SIGTERM) 10:03:54.934958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4531): Terminating (SIGTERM) 10:03:54.977662 --- ParallelTerminationStrategy: PID 4525 died... 10:03:54.998259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4525): Terminated: ok {rc=0} 10:03:55.044798 --- ParallelTerminationStrategy: PID 4528 died... 10:03:55.065137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4528): Terminated: ok {rc=0} 10:03:55.111429 --- ParallelTerminationStrategy: PID 4531 died... 10:03:55.131276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4531): Terminated: ok {rc=0} 10:03:55.219236 bus /sierra_3: Setting Powered False 10:03:56.318513 bus /sierra_3: Setting Powered False 10:03:57.435027 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:03:58.579385 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:03:58.591099 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:03:58.647324 tst mo_mt_call_osmux.py: using LAC 40167 10:03:58.767483 tst mo_mt_call_osmux.py: using RAC 132 10:03:58.887180 tst mo_mt_call_osmux.py: using CellId 40167 10:03:59.006022 tst mo_mt_call_osmux.py: using BVCI 40168 10:03:59.117836 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:03:59.128847 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:03:59.139635 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:03:59.150648 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:03:59.161942 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:03:59.173178 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:03:59.290592 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:03:59.411520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:59.912231 run create_hlr_db(pid=4534): Launched 10:04:00.044512 bus /sierra_2: Setting Powered False 10:04:01.126724 run create_hlr_db(pid=4534): Terminated: ok {rc=0} 10:04:01.591819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4536): Launched 10:04:01.935058 run osmo-hlr_10.42.42.2(pid=4537): Launched 10:04:02.087742 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:02.733203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4539): Launched 10:04:03.056104 run osmo-stp_10.42.42.5(pid=4540): Launched 10:04:03.179046 run osmo-msc_10.42.42.6: Starting osmo-msc 10:04:03.761794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4542): Launched 10:04:04.085433 run osmo-msc_10.42.42.6(pid=4543): Launched 10:04:04.265409 run osmo-stp_10.42.42.5(pid=4540): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4540)] 10:04:04.401211 run osmo-stp_10.42.42.5(pid=4540): stdout: | (launched: 2022-12-14_10:04:02.997321) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:04.537672 run osmo-stp_10.42.42.5(pid=4540): stderr: | 20221214100403185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100403185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100403186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100403186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100403186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100403187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100403187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:04.673125 run osmo-stp_10.42.42.5(pid=4540): stdout: | (launched: 2022-12-14_10:04:02.997321) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:04.801669 run osmo-stp_10.42.42.5(pid=4540): stderr: | 20221214100403185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100403185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100403186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100403186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100403186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100403187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100403187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:04.955566 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4540): Process ended prematurely: osmo-stp_10.42.42.5(pid=4540) [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4540)] [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:04:04.965381 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:04:04.993391 run osmo-hlr_10.42.42.2(pid=4537): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4537)] 10:04:05.043460 run osmo-hlr_10.42.42.2(pid=4537): stdout: | (launched: 2022-12-14_10:04:01.870239) 10:04:05.095197 run osmo-hlr_10.42.42.2(pid=4537): stderr: | 20221214100402215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100402215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100402215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100402215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100402215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100402215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100402229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100402246 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100402246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100402246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:05.167536 run osmo-msc_10.42.42.6(pid=4543): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4543)] 10:04:05.217577 run osmo-msc_10.42.42.6(pid=4543): stdout: | (launched: 2022-12-14_10:04:04.026428) 10:04:05.269296 run osmo-msc_10.42.42.6(pid=4543): stderr: | 20221214100404343 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100404343 DLGLOBAL DEBUG validating counter group 0x7f3ff4513c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100404344 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100404344 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100404344 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100404344 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100404346 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100404346 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100404346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100404346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:04:05.321885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4536): Terminating (SIGTERM) 10:04:05.363732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4539): Terminating (SIGTERM) 10:04:05.405891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4542): Terminating (SIGTERM) 10:04:05.447821 --- ParallelTerminationStrategy: PID 4536 died... 10:04:05.468055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4536): Terminated: ok {rc=0} 10:04:05.514177 --- ParallelTerminationStrategy: PID 4539 died... 10:04:05.533701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4539): Terminated: ok {rc=0} 10:04:05.579596 --- ParallelTerminationStrategy: PID 4542 died... 10:04:05.599180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4542): Terminated: ok {rc=0} 10:04:05.685888 bus /sierra_3: Setting Powered False 10:04:06.785908 bus /sierra_3: Setting Powered False 10:04:07.903302 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:04:09.142359 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:04:09.150162 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:04:09.170344 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:04:09.196864 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:04:09.246441 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:04:09.267177 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:04:09.293611 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:04:09.847879 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:04:09.899709 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:04:09.911199 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:04:09.967309 tst mo_mt_call.py: using LAC 40168 10:04:10.092488 tst mo_mt_call.py: using RAC 133 10:04:10.217661 tst mo_mt_call.py: using CellId 40168 10:04:10.336547 tst mo_mt_call.py: using BVCI 40169 10:04:10.447094 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:04:10.458226 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:04:10.469066 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:04:10.479874 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:04:10.491068 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:04:10.502187 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:04:10.623292 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:04:10.740343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:11.211087 run create_hlr_db(pid=4548): Launched 10:04:11.327366 bus /sierra_2: Setting Powered False 10:04:12.387365 run create_hlr_db(pid=4548): Terminated: ok {rc=0} 10:04:12.829532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4550): Launched 10:04:13.153685 run osmo-hlr_10.42.42.2(pid=4551): Launched 10:04:13.276573 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:13.835664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4553): Launched 10:04:14.158880 run osmo-stp_10.42.42.5(pid=4554): Launched 10:04:14.282152 run osmo-msc_10.42.42.6: Starting osmo-msc 10:04:14.866003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4556): Launched 10:04:15.190398 run osmo-msc_10.42.42.6(pid=4557): Launched 10:04:15.370936 run osmo-stp_10.42.42.5(pid=4554): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4554)] 10:04:15.507214 run osmo-stp_10.42.42.5(pid=4554): stdout: | (launched: 2022-12-14_10:04:14.100279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:15.645641 run osmo-stp_10.42.42.5(pid=4554): stderr: | 20221214100414288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100414288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100414289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100414289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100414290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100414290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100414290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:15.780487 run osmo-stp_10.42.42.5(pid=4554): stdout: | (launched: 2022-12-14_10:04:14.100279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:15.930273 run osmo-stp_10.42.42.5(pid=4554): stderr: | 20221214100414288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100414288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100414289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100414289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100414290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100414290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100414290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:16.094586 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4554): Process ended prematurely: osmo-stp_10.42.42.5(pid=4554) [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4554)] [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:04:16.103971 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:04:16.131940 run osmo-hlr_10.42.42.2(pid=4551): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4551)] 10:04:16.184582 run osmo-hlr_10.42.42.2(pid=4551): stdout: | (launched: 2022-12-14_10:04:13.095279) 10:04:16.236595 run osmo-hlr_10.42.42.2(pid=4551): stderr: | 20221214100413288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100413288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100413288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100413289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100413289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100413289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100413301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100413309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100413309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100413310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:16.310722 run osmo-msc_10.42.42.6(pid=4557): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4557)] 10:04:16.360400 run osmo-msc_10.42.42.6(pid=4557): stdout: | (launched: 2022-12-14_10:04:15.131469) 10:04:16.413638 run osmo-msc_10.42.42.6(pid=4557): stderr: | 20221214100415449 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100415450 DLGLOBAL DEBUG validating counter group 0x7fdbff98dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100415450 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100415450 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100415450 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100415450 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100415452 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100415452 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100415452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100415452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:04:16.467439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4550): Terminating (SIGTERM) 10:04:16.510223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4553): Terminating (SIGTERM) 10:04:16.559756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4556): Terminating (SIGTERM) 10:04:16.611655 --- ParallelTerminationStrategy: PID 4550 died... 10:04:16.636716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4550): Terminated: ok {rc=0} 10:04:16.696663 --- ParallelTerminationStrategy: PID 4553 died... 10:04:16.723157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4553): Terminated: ok {rc=0} 10:04:16.784171 --- ParallelTerminationStrategy: PID 4556 died... 10:04:16.806956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4556): Terminated: ok {rc=0} 10:04:16.907491 bus /sierra_3: Setting Powered False 10:04:18.003782 bus /sierra_3: Setting Powered False 10:04:19.119613 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:04:20.265638 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:04:20.279905 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:04:20.338227 tst mo_mt_call_osmux.py: using LAC 40169 10:04:20.465552 tst mo_mt_call_osmux.py: using RAC 134 10:04:20.593316 tst mo_mt_call_osmux.py: using CellId 40169 10:04:20.720465 tst mo_mt_call_osmux.py: using BVCI 40170 10:04:20.837601 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:04:20.849512 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:04:20.860896 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:04:20.872386 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:04:20.884077 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:04:20.895861 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:04:21.012674 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:04:21.134422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:21.637420 run create_hlr_db(pid=4559): Launched 10:04:21.769400 bus /sierra_2: Setting Powered False 10:04:22.833801 run create_hlr_db(pid=4559): Terminated: ok {rc=0} 10:04:23.267731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4561): Launched 10:04:23.573400 run osmo-hlr_10.42.42.2(pid=4562): Launched 10:04:23.691173 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:24.223299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4564): Launched 10:04:24.526986 run osmo-stp_10.42.42.5(pid=4565): Launched 10:04:24.643445 run osmo-msc_10.42.42.6: Starting osmo-msc 10:04:25.189653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4567): Launched 10:04:25.493563 run osmo-msc_10.42.42.6(pid=4568): Launched 10:04:25.663879 run osmo-stp_10.42.42.5(pid=4565): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4565)] 10:04:25.796532 run osmo-stp_10.42.42.5(pid=4565): stdout: | (launched: 2022-12-14_10:04:24.471529) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:25.925185 run osmo-stp_10.42.42.5(pid=4565): stderr: | 20221214100424635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100424636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100424636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100424636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100424637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100424637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100424637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:26.051397 run osmo-stp_10.42.42.5(pid=4565): stdout: | (launched: 2022-12-14_10:04:24.471529) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:26.171471 run osmo-stp_10.42.42.5(pid=4565): stderr: | 20221214100424635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100424636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100424636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100424636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100424637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100424637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100424637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:26.315538 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4565): Process ended prematurely: osmo-stp_10.42.42.5(pid=4565) [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4565)] [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:04:26.324382 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:04:26.351086 run osmo-hlr_10.42.42.2(pid=4562): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4562)] 10:04:26.399367 run osmo-hlr_10.42.42.2(pid=4562): stdout: | (launched: 2022-12-14_10:04:23.517666) 10:04:26.449348 run osmo-hlr_10.42.42.2(pid=4562): stderr: | 20221214100423689 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100423689 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100423689 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100423689 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100423689 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100423689 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100423703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100423711 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100423711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100423712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:26.519034 run osmo-msc_10.42.42.6(pid=4568): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4568)] 10:04:26.566718 run osmo-msc_10.42.42.6(pid=4568): stdout: | (launched: 2022-12-14_10:04:25.437885) 10:04:26.616398 run osmo-msc_10.42.42.6(pid=4568): stderr: | 20221214100425706 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100425706 DLGLOBAL DEBUG validating counter group 0x7f6196dddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100425706 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100425706 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100425707 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100425707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100425709 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100425709 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100425709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100425709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:04:26.666408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4561): Terminating (SIGTERM) 10:04:26.706569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4564): Terminating (SIGTERM) 10:04:26.746468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4567): Terminating (SIGTERM) 10:04:26.786551 --- ParallelTerminationStrategy: PID 4561 died... 10:04:26.806039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4561): Terminated: ok {rc=0} 10:04:26.850191 --- ParallelTerminationStrategy: PID 4564 died... 10:04:26.868932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4564): Terminated: ok {rc=0} 10:04:26.913236 --- ParallelTerminationStrategy: PID 4567 died... 10:04:26.932099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4567): Terminated: ok {rc=0} 10:04:27.019469 bus /sierra_3: Setting Powered False 10:04:28.116051 bus /sierra_3: Setting Powered False 10:04:29.228576 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:04:30.463339 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:04:30.470477 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:04:30.491538 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:04:30.519531 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:04:30.576006 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:04:30.598382 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:04:30.625290 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:04:31.188415 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:04:31.242132 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:04:31.254216 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:04:31.313918 tst mo_mt_call.py: using LAC 40170 10:04:31.435019 tst mo_mt_call.py: using RAC 135 10:04:31.586122 tst mo_mt_call.py: using CellId 40170 10:04:31.714311 tst mo_mt_call.py: using BVCI 40171 10:04:31.852704 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:04:31.864879 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:04:31.877919 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:04:31.889699 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:04:31.901962 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:04:31.914071 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:04:32.051980 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:04:32.195185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:32.675574 run create_hlr_db(pid=4573): Launched 10:04:32.809168 bus /sierra_2: Setting Powered False 10:04:33.869471 run create_hlr_db(pid=4573): Terminated: ok {rc=0} 10:04:34.321234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4575): Launched 10:04:34.645117 run osmo-hlr_10.42.42.2(pid=4576): Launched 10:04:34.767409 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:35.325635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4578): Launched 10:04:35.649111 run osmo-stp_10.42.42.5(pid=4579): Launched 10:04:35.771503 run osmo-msc_10.42.42.6: Starting osmo-msc 10:04:36.355961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4581): Launched 10:04:36.679191 run osmo-msc_10.42.42.6(pid=4582): Launched 10:04:36.859262 run osmo-stp_10.42.42.5(pid=4579): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4579)] 10:04:36.995587 run osmo-stp_10.42.42.5(pid=4579): stdout: | (launched: 2022-12-14_10:04:35.590172) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:37.132458 run osmo-stp_10.42.42.5(pid=4579): stderr: | 20221214100435779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100435779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100435780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100435780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100435780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100435781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100435781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:37.267661 run osmo-stp_10.42.42.5(pid=4579): stdout: | (launched: 2022-12-14_10:04:35.590172) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:37.395982 run osmo-stp_10.42.42.5(pid=4579): stderr: | 20221214100435779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100435779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100435780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100435780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100435780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100435781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100435781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:37.549804 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4579): Process ended prematurely: osmo-stp_10.42.42.5(pid=4579) [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4579)] [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:04:37.559297 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:04:37.587282 run osmo-hlr_10.42.42.2(pid=4576): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4576)] 10:04:37.638183 run osmo-hlr_10.42.42.2(pid=4576): stdout: | (launched: 2022-12-14_10:04:34.586391) 10:04:37.690563 run osmo-hlr_10.42.42.2(pid=4576): stderr: | 20221214100434781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100434781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100434781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100434781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100434781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100434782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100434794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100434802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100434802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100434802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:37.763316 run osmo-msc_10.42.42.6(pid=4582): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4582)] 10:04:37.813543 run osmo-msc_10.42.42.6(pid=4582): stdout: | (launched: 2022-12-14_10:04:36.620334) 10:04:37.865568 run osmo-msc_10.42.42.6(pid=4582): stderr: | 20221214100436937 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100436938 DLGLOBAL DEBUG validating counter group 0x7f23e7917c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100436938 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100436938 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100436938 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100436938 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100436940 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100436940 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100436940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100436940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:04:37.918892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4575): Terminating (SIGTERM) 10:04:37.960814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4578): Terminating (SIGTERM) 10:04:38.003657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4581): Terminating (SIGTERM) 10:04:38.046076 --- ParallelTerminationStrategy: PID 4575 died... 10:04:38.066272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4575): Terminated: ok {rc=0} 10:04:38.112682 --- ParallelTerminationStrategy: PID 4578 died... 10:04:38.132552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4578): Terminated: ok {rc=0} 10:04:38.178642 --- ParallelTerminationStrategy: PID 4581 died... 10:04:38.198172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4581): Terminated: ok {rc=0} 10:04:38.286732 bus /sierra_3: Setting Powered False 10:04:39.386276 bus /sierra_3: Setting Powered False 10:04:40.503304 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:04:41.653324 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:04:41.665485 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:04:41.723995 tst mo_mt_call_osmux.py: using LAC 40171 10:04:41.842664 tst mo_mt_call_osmux.py: using RAC 136 10:04:41.963548 tst mo_mt_call_osmux.py: using CellId 40171 10:04:42.083808 tst mo_mt_call_osmux.py: using BVCI 40172 10:04:42.195359 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:04:42.206469 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:04:42.217454 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:04:42.228247 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:04:42.239547 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:04:42.250999 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:04:42.366084 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:04:42.486501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:42.989705 run create_hlr_db(pid=4584): Launched 10:04:43.122415 bus /sierra_2: Setting Powered False 10:04:44.186350 run create_hlr_db(pid=4584): Terminated: ok {rc=0} 10:04:44.619955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4586): Launched 10:04:44.923547 run osmo-hlr_10.42.42.2(pid=4587): Launched 10:04:45.040480 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:45.559395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4589): Launched 10:04:45.871889 run osmo-stp_10.42.42.5(pid=4590): Launched 10:04:46.141568 run osmo-msc_10.42.42.6: Starting osmo-msc 10:04:46.775716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4592): Launched 10:04:47.102801 run osmo-msc_10.42.42.6(pid=4593): Launched 10:04:47.416151 run osmo-stp_10.42.42.5(pid=4590): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4590)] 10:04:47.554145 run osmo-stp_10.42.42.5(pid=4590): stdout: | (launched: 2022-12-14_10:04:45.807859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:47.691322 run osmo-stp_10.42.42.5(pid=4590): stderr: | 20221214100446045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100446045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100446046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100446046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100446047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100446047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100446047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:47.827187 run osmo-stp_10.42.42.5(pid=4590): stdout: | (launched: 2022-12-14_10:04:45.807859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:47.956662 run osmo-stp_10.42.42.5(pid=4590): stderr: | 20221214100446045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100446045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100446046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100446046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100446047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100446047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100446047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:48.111794 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4590): Process ended prematurely: osmo-stp_10.42.42.5(pid=4590) [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4590)] [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:04:48.121612 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:04:48.149734 run osmo-hlr_10.42.42.2(pid=4587): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4587)] 10:04:48.200337 run osmo-hlr_10.42.42.2(pid=4587): stdout: | (launched: 2022-12-14_10:04:44.868296) 10:04:48.252589 run osmo-hlr_10.42.42.2(pid=4587): stderr: | 20221214100445037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100445037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100445037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100445037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100445037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100445037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100445050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100445058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100445058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100445058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:48.325710 run osmo-msc_10.42.42.6(pid=4593): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4593)] 10:04:48.376193 run osmo-msc_10.42.42.6(pid=4593): stdout: | (launched: 2022-12-14_10:04:47.042430) 10:04:48.428381 run osmo-msc_10.42.42.6(pid=4593): stderr: | 20221214100447374 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100447374 DLGLOBAL DEBUG validating counter group 0x7f52dc760c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100447374 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100447374 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100447375 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100447375 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100447376 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100447377 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100447377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100447377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:04:48.481217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4586): Terminating (SIGTERM) 10:04:48.523473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4589): Terminating (SIGTERM) 10:04:48.566066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4592): Terminating (SIGTERM) 10:04:48.608627 --- ParallelTerminationStrategy: PID 4586 died... 10:04:48.629323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4586): Terminated: ok {rc=0} 10:04:48.675914 --- ParallelTerminationStrategy: PID 4589 died... 10:04:48.695769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4589): Terminated: ok {rc=0} 10:04:48.742335 --- ParallelTerminationStrategy: PID 4592 died... 10:04:48.762186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4592): Terminated: ok {rc=0} 10:04:48.850484 bus /sierra_3: Setting Powered False 10:04:49.949285 bus /sierra_3: Setting Powered False 10:04:51.065390 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:04:52.297449 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:04:52.305208 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:04:52.326149 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:04:52.353595 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:04:52.404837 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:04:52.425929 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:04:52.452330 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:04:53.007058 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:04:53.058923 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:04:53.070291 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:04:53.127091 tst mo_mt_call.py: using LAC 40172 10:04:53.257230 tst mo_mt_call.py: using RAC 137 10:04:53.384399 tst mo_mt_call.py: using CellId 40172 10:04:53.509346 tst mo_mt_call.py: using BVCI 40173 10:04:53.626817 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:04:53.638580 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:04:53.649794 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:04:53.660911 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:04:53.672243 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:04:53.683572 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:04:53.798946 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:04:53.918074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:54.420058 run create_hlr_db(pid=4598): Launched 10:04:54.551570 bus /sierra_2: Setting Powered False 10:04:55.616329 run create_hlr_db(pid=4598): Terminated: ok {rc=0} 10:04:56.067425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4600): Launched 10:04:56.390618 run osmo-hlr_10.42.42.2(pid=4601): Launched 10:04:56.515105 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:57.079015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4603): Launched 10:04:57.405323 run osmo-stp_10.42.42.5(pid=4604): Launched 10:04:57.528729 run osmo-msc_10.42.42.6: Starting osmo-msc 10:04:58.115764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4606): Launched 10:04:58.439434 run osmo-msc_10.42.42.6(pid=4607): Launched 10:04:58.621165 run osmo-stp_10.42.42.5(pid=4604): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4604)] 10:04:58.757170 run osmo-stp_10.42.42.5(pid=4604): stdout: | (launched: 2022-12-14_10:04:57.346231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:58.893628 run osmo-stp_10.42.42.5(pid=4604): stderr: | 20221214100457537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100457537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100457537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100457538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100457538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100457538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100457538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:59.029592 run osmo-stp_10.42.42.5(pid=4604): stdout: | (launched: 2022-12-14_10:04:57.346231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:59.158019 run osmo-stp_10.42.42.5(pid=4604): stderr: | 20221214100457537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100457537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100457537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100457538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100457538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100457538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100457538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:59.311896 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4604): Process ended prematurely: osmo-stp_10.42.42.5(pid=4604) [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4604)] [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:04:59.321746 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:04:59.349996 run osmo-hlr_10.42.42.2(pid=4601): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4601)] 10:04:59.400656 run osmo-hlr_10.42.42.2(pid=4601): stdout: | (launched: 2022-12-14_10:04:56.331613) 10:04:59.452720 run osmo-hlr_10.42.42.2(pid=4601): stderr: | 20221214100456527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100456527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100456527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100456528 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100456528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100456528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100456539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100456548 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100456548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100456548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:59.525700 run osmo-msc_10.42.42.6(pid=4607): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4607)] 10:04:59.576015 run osmo-msc_10.42.42.6(pid=4607): stdout: | (launched: 2022-12-14_10:04:58.380508) 10:04:59.628125 run osmo-msc_10.42.42.6(pid=4607): stderr: | 20221214100458702 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100458702 DLGLOBAL DEBUG validating counter group 0x7f60db870c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100458702 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100458702 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100458702 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100458702 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100458704 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100458704 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100458705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100458705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:04:59.680573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4600): Terminating (SIGTERM) 10:04:59.722634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4603): Terminating (SIGTERM) 10:04:59.764882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4606): Terminating (SIGTERM) 10:04:59.808055 --- ParallelTerminationStrategy: PID 4600 died... 10:04:59.828470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4600): Terminated: ok {rc=0} 10:04:59.875072 --- ParallelTerminationStrategy: PID 4603 died... 10:04:59.894886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4603): Terminated: ok {rc=0} 10:04:59.941327 --- ParallelTerminationStrategy: PID 4606 died... 10:04:59.960906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4606): Terminated: ok {rc=0} 10:05:00.050166 bus /sierra_3: Setting Powered False 10:05:01.151043 bus /sierra_3: Setting Powered False 10:05:02.276013 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:05:03.418796 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:05:03.430634 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:05:03.491915 tst mo_mt_call_osmux.py: using LAC 40173 10:05:03.615861 tst mo_mt_call_osmux.py: using RAC 138 10:05:03.734847 tst mo_mt_call_osmux.py: using CellId 40173 10:05:03.856754 tst mo_mt_call_osmux.py: using BVCI 40174 10:05:03.968231 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:05:03.979297 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:05:03.990382 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:05:04.001400 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:05:04.012485 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:05:04.023761 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:05:04.143729 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:05:04.260378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:04.729064 run create_hlr_db(pid=4619): Launched 10:05:04.844916 bus /sierra_2: Setting Powered False 10:05:05.905454 run create_hlr_db(pid=4619): Terminated: ok {rc=0} 10:05:06.346932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4621): Launched 10:05:06.672076 run osmo-hlr_10.42.42.2(pid=4622): Launched 10:05:06.797996 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:07.354521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4624): Launched 10:05:07.680116 run osmo-stp_10.42.42.5(pid=4625): Launched 10:05:07.802540 run osmo-msc_10.42.42.6: Starting osmo-msc 10:05:08.385975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4627): Launched 10:05:08.710079 run osmo-msc_10.42.42.6(pid=4628): Launched 10:05:08.890991 run osmo-stp_10.42.42.5(pid=4625): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4625)] 10:05:09.026551 run osmo-stp_10.42.42.5(pid=4625): stdout: | (launched: 2022-12-14_10:05:07.620291) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:09.162931 run osmo-stp_10.42.42.5(pid=4625): stderr: | 20221214100507808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100507809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100507809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100507809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100507810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100507810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100507810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:09.297864 run osmo-stp_10.42.42.5(pid=4625): stdout: | (launched: 2022-12-14_10:05:07.620291) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:09.425736 run osmo-stp_10.42.42.5(pid=4625): stderr: | 20221214100507808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100507809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100507809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100507809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100507810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100507810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100507810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:09.579091 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4625): Process ended prematurely: osmo-stp_10.42.42.5(pid=4625) [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4625)] [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:05:09.588453 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:05:09.616517 run osmo-hlr_10.42.42.2(pid=4622): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4622)] 10:05:09.666439 run osmo-hlr_10.42.42.2(pid=4622): stdout: | (launched: 2022-12-14_10:05:06.612888) 10:05:09.718429 run osmo-hlr_10.42.42.2(pid=4622): stderr: | 20221214100506807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100506807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100506807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100506807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100506807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100506807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100506820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100506831 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100506831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100506831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:09.790879 run osmo-msc_10.42.42.6(pid=4628): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4628)] 10:05:09.841160 run osmo-msc_10.42.42.6(pid=4628): stdout: | (launched: 2022-12-14_10:05:08.651168) 10:05:09.893373 run osmo-msc_10.42.42.6(pid=4628): stderr: | 20221214100508969 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100508969 DLGLOBAL DEBUG validating counter group 0x7f0b0a173c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100508969 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100508969 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100508970 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100508970 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100508971 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100508972 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100508972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100508972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:05:09.945717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4621): Terminating (SIGTERM) 10:05:09.987978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4624): Terminating (SIGTERM) 10:05:10.030028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4627): Terminating (SIGTERM) 10:05:10.072149 --- ParallelTerminationStrategy: PID 4621 died... 10:05:10.092399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4621): Terminated: ok {rc=0} 10:05:10.138699 --- ParallelTerminationStrategy: PID 4624 died... 10:05:10.158343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4624): Terminated: ok {rc=0} 10:05:10.204451 --- ParallelTerminationStrategy: PID 4627 died... 10:05:10.224246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4627): Terminated: ok {rc=0} 10:05:10.312340 bus /sierra_3: Setting Powered False 10:05:11.411111 bus /sierra_3: Setting Powered False 10:05:12.531536 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:05:13.781422 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:05:13.788551 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:05:13.810000 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:05:13.841327 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:05:13.897121 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:05:13.921571 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:05:13.950138 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:05:14.497623 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:05:14.546899 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:05:14.558182 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:05:14.614257 tst mo_mt_call.py: using LAC 40174 10:05:14.733408 tst mo_mt_call.py: using RAC 139 10:05:14.851881 tst mo_mt_call.py: using CellId 40174 10:05:14.971274 tst mo_mt_call.py: using BVCI 40175 10:05:15.082399 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:05:15.093475 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:05:15.104244 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:05:15.115053 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:05:15.126602 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:05:15.137918 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:05:15.258180 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:05:15.375832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:15.857683 run create_hlr_db(pid=4985): Launched 10:05:16.020169 bus /sierra_2: Setting Powered False 10:05:17.091233 run create_hlr_db(pid=4985): Terminated: ok {rc=0} 10:05:17.550504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4987): Launched 10:05:17.854838 run osmo-hlr_10.42.42.2(pid=4988): Launched 10:05:17.970881 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:18.504792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4990): Launched 10:05:18.807495 run osmo-stp_10.42.42.5(pid=4991): Launched 10:05:18.923051 run osmo-msc_10.42.42.6: Starting osmo-msc 10:05:19.470510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4993): Launched 10:05:19.773440 run osmo-msc_10.42.42.6(pid=4994): Launched 10:05:19.943655 run osmo-stp_10.42.42.5(pid=4991): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4991)] 10:05:20.071684 run osmo-stp_10.42.42.5(pid=4991): stdout: | (launched: 2022-12-14_10:05:18.752131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:20.200402 run osmo-stp_10.42.42.5(pid=4991): stderr: | 20221214100518921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100518921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100518921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100518922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100518922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100518922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100518922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:20.327433 run osmo-stp_10.42.42.5(pid=4991): stdout: | (launched: 2022-12-14_10:05:18.752131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:20.448056 run osmo-stp_10.42.42.5(pid=4991): stderr: | 20221214100518921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100518921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100518921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100518922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100518922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100518922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100518922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:20.592478 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4991): Process ended prematurely: osmo-stp_10.42.42.5(pid=4991) [trial-2403↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4991)] [trial-2403↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:05:20.601577 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:05:20.628164 run osmo-hlr_10.42.42.2(pid=4988): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4988)] 10:05:20.676350 run osmo-hlr_10.42.42.2(pid=4988): stdout: | (launched: 2022-12-14_10:05:17.799709) 10:05:20.725805 run osmo-hlr_10.42.42.2(pid=4988): stderr: | 20221214100517975 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100517975 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100517975 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100517975 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100517975 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100517975 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100517987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100517996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100517996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100517996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:20.795087 run osmo-msc_10.42.42.6(pid=4994): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4994)] 10:05:20.842677 run osmo-msc_10.42.42.6(pid=4994): stdout: | (launched: 2022-12-14_10:05:19.718033) 10:05:20.892012 run osmo-msc_10.42.42.6(pid=4994): stderr: | 20221214100519988 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100519988 DLGLOBAL DEBUG validating counter group 0x7f403bc40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100519988 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100519988 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100519988 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100519988 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100519990 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100519991 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100519991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100519991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:05:20.942025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4987): Terminating (SIGTERM) 10:05:20.982246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4990): Terminating (SIGTERM) 10:05:21.022269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4993): Terminating (SIGTERM) 10:05:21.062599 --- ParallelTerminationStrategy: PID 4987 died... 10:05:21.082198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4987): Terminated: ok {rc=0} 10:05:21.126451 --- ParallelTerminationStrategy: PID 4990 died... 10:05:21.145558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4990): Terminated: ok {rc=0} 10:05:21.189883 --- ParallelTerminationStrategy: PID 4993 died... 10:05:21.209062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4993): Terminated: ok {rc=0} 10:05:21.292988 bus /sierra_3: Setting Powered False 10:05:22.391412 bus /sierra_3: Setting Powered False 10:05:23.517212 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:05:24.670366 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:05:24.683196 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:05:24.743732 tst mo_mt_call_osmux.py: using LAC 40175 10:05:24.866477 tst mo_mt_call_osmux.py: using RAC 140 10:05:24.991661 tst mo_mt_call_osmux.py: using CellId 40175 10:05:25.115137 tst mo_mt_call_osmux.py: using BVCI 40176 10:05:25.228399 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:05:25.240397 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:05:25.252194 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:05:25.263955 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:05:25.277013 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:05:25.290938 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:05:25.412898 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:05:25.533554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:26.014899 run create_hlr_db(pid=5171): Launched 10:05:26.178182 bus /sierra_2: Setting Powered False 10:05:27.245455 run create_hlr_db(pid=5171): Terminated: ok {rc=0} 10:05:27.712683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5173): Launched 10:05:28.060536 run osmo-hlr_10.42.42.2(pid=5174): Launched 10:05:28.314217 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:28.939346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5177): Launched 10:05:29.247205 run osmo-stp_10.42.42.5(pid=5178): Launched 10:05:29.365144 run osmo-msc_10.42.42.6: Starting osmo-msc 10:05:29.919143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5180): Launched 10:05:30.227665 run osmo-msc_10.42.42.6(pid=5181): Launched 10:05:30.400552 run osmo-stp_10.42.42.5(pid=5178): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5178)] 10:05:30.534453 run osmo-stp_10.42.42.5(pid=5178): stdout: | (launched: 2022-12-14_10:05:29.191317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:30.664255 run osmo-stp_10.42.42.5(pid=5178): stderr: | 20221214100529358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100529358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100529358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100529358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100529359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100529359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100529359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:30.792463 run osmo-stp_10.42.42.5(pid=5178): stdout: | (launched: 2022-12-14_10:05:29.191317) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:30.933500 run osmo-stp_10.42.42.5(pid=5178): stderr: | 20221214100529358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100529358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100529358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100529358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100529359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100529359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100529359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:31.084382 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5178): Process ended prematurely: osmo-stp_10.42.42.5(pid=5178) [trial-2403↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5178)] [trial-2403↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:05:31.094536 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:05:31.122645 run osmo-hlr_10.42.42.2(pid=5174): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5174)] 10:05:31.175765 run osmo-hlr_10.42.42.2(pid=5174): stdout: | (launched: 2022-12-14_10:05:27.998873) 10:05:31.228430 run osmo-hlr_10.42.42.2(pid=5174): stderr: | 20221214100528304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100528304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100528304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100528304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100528304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100528304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100528326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100528334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100528335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100528335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:31.301657 run osmo-msc_10.42.42.6(pid=5181): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5181)] 10:05:31.351413 run osmo-msc_10.42.42.6(pid=5181): stdout: | (launched: 2022-12-14_10:05:30.171382) 10:05:31.405266 run osmo-msc_10.42.42.6(pid=5181): stderr: | 20221214100530439 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100530439 DLGLOBAL DEBUG validating counter group 0x7f9c50eeec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100530439 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100530439 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100530439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100530440 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100530441 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100530442 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100530442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100530442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:05:31.458653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5173): Terminating (SIGTERM) 10:05:31.500758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5177): Terminating (SIGTERM) 10:05:31.545519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5180): Terminating (SIGTERM) 10:05:31.590180 --- ParallelTerminationStrategy: PID 5173 died... 10:05:31.611725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5173): Terminated: ok {rc=0} 10:05:31.658895 --- ParallelTerminationStrategy: PID 5177 died... 10:05:31.679985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5177): Terminated: ok {rc=0} 10:05:31.727056 --- ParallelTerminationStrategy: PID 5180 died... 10:05:31.748061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5180): Terminated: ok {rc=0} 10:05:31.840158 bus /sierra_3: Setting Powered False 10:05:32.940343 bus /sierra_3: Setting Powered False 10:05:34.058298 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:05:35.292388 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:05:35.298094 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:05:35.318698 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:05:35.346015 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:05:35.400037 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:05:35.421663 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:05:35.448449 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:05:35.993397 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:05:36.044200 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:05:36.055272 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:05:36.113337 tst mo_mt_call.py: using LAC 40176 10:05:36.234241 tst mo_mt_call.py: using RAC 141 10:05:36.357180 tst mo_mt_call.py: using CellId 40176 10:05:36.478626 tst mo_mt_call.py: using BVCI 40177 10:05:36.591337 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:05:36.602456 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:05:36.613146 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:05:36.623620 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:05:36.634586 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:05:36.645736 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:05:36.767985 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:05:36.885334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:37.359954 run create_hlr_db(pid=5186): Launched 10:05:37.477897 bus /sierra_2: Setting Powered False 10:05:38.538891 run create_hlr_db(pid=5186): Terminated: ok {rc=0} 10:05:38.968491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5188): Launched 10:05:39.275916 run osmo-hlr_10.42.42.2(pid=5189): Launched 10:05:39.394054 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:39.935473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5191): Launched 10:05:40.243750 run osmo-stp_10.42.42.5(pid=5192): Launched 10:05:40.361164 run osmo-msc_10.42.42.6: Starting osmo-msc 10:05:40.915511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5194): Launched 10:05:41.222085 run osmo-msc_10.42.42.6(pid=5195): Launched 10:05:41.393530 run osmo-stp_10.42.42.5(pid=5192): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5192)] 10:05:41.522817 run osmo-stp_10.42.42.5(pid=5192): stdout: | (launched: 2022-12-14_10:05:40.187574) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:41.652551 run osmo-stp_10.42.42.5(pid=5192): stderr: | 20221214100540356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100540357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100540357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100540357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100540358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100540358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100540358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:41.780586 run osmo-stp_10.42.42.5(pid=5192): stdout: | (launched: 2022-12-14_10:05:40.187574) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:41.902689 run osmo-stp_10.42.42.5(pid=5192): stderr: | 20221214100540356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100540357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100540357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100540357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100540358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100540358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100540358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:42.048836 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5192): Process ended prematurely: osmo-stp_10.42.42.5(pid=5192) [trial-2403↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5192)] [trial-2403↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:05:42.058140 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:05:42.084815 run osmo-hlr_10.42.42.2(pid=5189): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5189)] 10:05:42.133943 run osmo-hlr_10.42.42.2(pid=5189): stdout: | (launched: 2022-12-14_10:05:39.219662) 10:05:42.184354 run osmo-hlr_10.42.42.2(pid=5189): stderr: | 20221214100539395 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100539395 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100539395 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100539395 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100539395 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100539395 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100539407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100539416 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100539416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100539416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:42.254748 run osmo-msc_10.42.42.6(pid=5195): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5195)] 10:05:42.302642 run osmo-msc_10.42.42.6(pid=5195): stdout: | (launched: 2022-12-14_10:05:41.166028) 10:05:42.352661 run osmo-msc_10.42.42.6(pid=5195): stderr: | 20221214100541434 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100541435 DLGLOBAL DEBUG validating counter group 0x7f8971471c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100541435 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100541435 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100541435 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100541435 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100541437 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100541437 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100541438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100541438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:05:42.403746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5188): Terminating (SIGTERM) 10:05:42.443713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5191): Terminating (SIGTERM) 10:05:42.483714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5194): Terminating (SIGTERM) 10:05:42.525378 --- ParallelTerminationStrategy: PID 5188 died... 10:05:42.545047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5188): Terminated: ok {rc=0} 10:05:42.589581 --- ParallelTerminationStrategy: PID 5191 died... 10:05:42.608281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5191): Terminated: ok {rc=0} 10:05:42.652607 --- ParallelTerminationStrategy: PID 5194 died... 10:05:42.671757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5194): Terminated: ok {rc=0} 10:05:42.758234 bus /sierra_3: Setting Powered False 10:05:43.857953 bus /sierra_3: Setting Powered False 10:05:44.975489 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:05:46.149183 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:05:46.166137 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:05:46.227019 tst mo_mt_call_osmux.py: using LAC 40177 10:05:46.350987 tst mo_mt_call_osmux.py: using RAC 142 10:05:46.473787 tst mo_mt_call_osmux.py: using CellId 40177 10:05:46.643040 tst mo_mt_call_osmux.py: using BVCI 40178 10:05:46.793901 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:05:46.809145 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:05:46.823969 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:05:46.840098 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:05:46.855843 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:05:46.872353 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:05:47.012847 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:05:47.135319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:47.613913 run create_hlr_db(pid=5198): Launched 10:05:47.749787 bus /sierra_2: Setting Powered False 10:05:48.814538 run create_hlr_db(pid=5198): Terminated: ok {rc=0} 10:05:49.271996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5200): Launched 10:05:49.600711 run osmo-hlr_10.42.42.2(pid=5201): Launched 10:05:49.725568 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:50.287119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5203): Launched 10:05:50.614985 run osmo-stp_10.42.42.5(pid=5204): Launched 10:05:50.739324 run osmo-msc_10.42.42.6: Starting osmo-msc 10:05:51.334738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5206): Launched 10:05:51.663773 run osmo-msc_10.42.42.6(pid=5207): Launched 10:05:51.846206 run osmo-stp_10.42.42.5(pid=5204): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5204)] 10:05:51.986911 run osmo-stp_10.42.42.5(pid=5204): stdout: | (launched: 2022-12-14_10:05:50.555404) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:52.128398 run osmo-stp_10.42.42.5(pid=5204): stderr: | 20221214100550745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100550745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100550746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100550746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100550747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100550747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100550747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:52.266105 run osmo-stp_10.42.42.5(pid=5204): stdout: | (launched: 2022-12-14_10:05:50.555404) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:52.396351 run osmo-stp_10.42.42.5(pid=5204): stderr: | 20221214100550745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100550745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100550746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100550746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100550747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100550747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100550747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:52.552166 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5204): Process ended prematurely: osmo-stp_10.42.42.5(pid=5204) [trial-2403↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5204)] [trial-2403↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:05:52.562168 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:05:52.590514 run osmo-hlr_10.42.42.2(pid=5201): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5201)] 10:05:52.641131 run osmo-hlr_10.42.42.2(pid=5201): stdout: | (launched: 2022-12-14_10:05:49.540750) 10:05:52.693475 run osmo-hlr_10.42.42.2(pid=5201): stderr: | 20221214100549740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100549740 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100549740 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100549740 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100549740 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100549740 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100549752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100549760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100549760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100549760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:52.766449 run osmo-msc_10.42.42.6(pid=5207): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5207)] 10:05:52.817190 run osmo-msc_10.42.42.6(pid=5207): stdout: | (launched: 2022-12-14_10:05:51.603597) 10:05:52.869479 run osmo-msc_10.42.42.6(pid=5207): stderr: | 20221214100551923 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100551924 DLGLOBAL DEBUG validating counter group 0x7f14e22fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100551924 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100551924 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100551924 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100551924 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100551926 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100551926 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100551926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100551926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:05:52.922187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5200): Terminating (SIGTERM) 10:05:52.964112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5203): Terminating (SIGTERM) 10:05:53.006729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5206): Terminating (SIGTERM) 10:05:53.049125 --- ParallelTerminationStrategy: PID 5200 died... 10:05:53.069617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5200): Terminated: ok {rc=0} 10:05:53.116262 --- ParallelTerminationStrategy: PID 5203 died... 10:05:53.136200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5203): Terminated: ok {rc=0} 10:05:53.182448 --- ParallelTerminationStrategy: PID 5206 died... 10:05:53.202166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5206): Terminated: ok {rc=0} 10:05:53.290287 bus /sierra_3: Setting Powered False 10:05:54.389151 bus /sierra_3: Setting Powered False 10:05:55.505958 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 emergency:oc2g --------------------------------------------------------------------- 10:05:56.739485 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:05:56.744041 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 10:05:56.764896 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 10:05:56.793714 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 10:05:56.880811 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 10:05:56.901874 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 10:05:56.929277 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 10:05:57.513198 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2403 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 10:05:57.518389 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:05:57.529469 tst emergency:oc2g: Using 1 x bts (candidates: 1) 10:05:57.565680 tst emergency_mo_mt_call.py: using LAC 40178 10:05:57.684712 tst emergency_mo_mt_call.py: using RAC 143 10:05:57.802360 tst emergency_mo_mt_call.py: using CellId 40178 10:05:57.922202 tst emergency_mo_mt_call.py: using BVCI 40179 10:05:58.033363 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:05:58.043932 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:05:58.054675 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:05:58.064857 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:05:58.075504 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:05:58.086130 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:05:58.206416 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:05:58.322119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:58.786614 run create_hlr_db(pid=5213): Launched 10:05:58.901318 bus /sierra_2: Setting Powered False 10:05:59.961843 run create_hlr_db(pid=5213): Terminated: ok {rc=0} 10:06:00.403592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5215): Launched 10:06:00.727340 run osmo-hlr_10.42.42.2(pid=5216): Launched 10:06:00.907444 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:01.576174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5218): Launched 10:06:01.917768 run osmo-stp_10.42.42.5(pid=5219): Launched 10:06:02.067909 tst emergency_mo_mt_call.py: using MSISDN 8632 10:06:02.348113 run osmo-msc_10.42.42.6: Starting osmo-msc 10:06:02.925873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5221): Launched 10:06:03.276534 run osmo-msc_10.42.42.6(pid=5222): Launched 10:06:03.455830 run osmo-stp_10.42.42.5(pid=5219): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5219)] 10:06:03.591401 run osmo-stp_10.42.42.5(pid=5219): stdout: | (launched: 2022-12-14_10:06:01.853365) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:03.727266 run osmo-stp_10.42.42.5(pid=5219): stderr: | 20221214100602174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100602174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100602174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100602174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100602175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100602175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100602175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:03.861809 run osmo-stp_10.42.42.5(pid=5219): stdout: | (launched: 2022-12-14_10:06:01.853365) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:03.989320 run osmo-stp_10.42.42.5(pid=5219): stderr: | 20221214100602174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100602174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100602174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100602174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100602175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100602175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100602175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:04.142476 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5219): Process ended prematurely: osmo-stp_10.42.42.5(pid=5219) [trial-2403↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5219)] [trial-2403↪emergency:oc2g↪emergency_mo_mt_call.py:19] 10:06:04.151444 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 10:06:04.179063 run osmo-hlr_10.42.42.2(pid=5216): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5216)] 10:06:04.229758 run osmo-hlr_10.42.42.2(pid=5216): stdout: | (launched: 2022-12-14_10:06:00.668667) 10:06:04.282201 run osmo-hlr_10.42.42.2(pid=5216): stderr: | 20221214100600865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100600865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100600865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100600865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100600865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100600866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100600898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100600917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100600917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100600917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:04.355463 run osmo-msc_10.42.42.6(pid=5222): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5222)] 10:06:04.405765 run osmo-msc_10.42.42.6(pid=5222): stdout: | (launched: 2022-12-14_10:06:03.217742) 10:06:04.457775 run osmo-msc_10.42.42.6(pid=5222): stderr: | 20221214100603538 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100603538 DLGLOBAL DEBUG validating counter group 0x7f047dc88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100603538 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100603538 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100603538 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100603538 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100603540 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100603540 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100603541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100603541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:06:04.510205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5215): Terminating (SIGTERM) 10:06:04.552060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5218): Terminating (SIGTERM) 10:06:04.594564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5221): Terminating (SIGTERM) 10:06:04.637054 --- ParallelTerminationStrategy: PID 5215 died... 10:06:04.657209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5215): Terminated: ok {rc=0} 10:06:04.703418 --- ParallelTerminationStrategy: PID 5218 died... 10:06:04.723072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5218): Terminated: ok {rc=0} 10:06:04.769287 --- ParallelTerminationStrategy: PID 5221 died... 10:06:04.788843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5221): Terminated: ok {rc=0} 10:06:04.877323 bus /sierra_3: Setting Powered False 10:06:05.976798 bus /sierra_3: Setting Powered False 10:06:07.094561 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 10:06:08.182644 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:06:08.194948 tst emergency:oc2g: Using 1 x bts (candidates: 1) 10:06:08.232465 tst emergency_preemptive_call.py: using LAC 40179 10:06:08.359149 tst emergency_preemptive_call.py: using RAC 144 10:06:08.485368 tst emergency_preemptive_call.py: using CellId 40179 10:06:08.612909 tst emergency_preemptive_call.py: using BVCI 40180 10:06:08.723675 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:06:08.734287 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:06:08.744660 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:06:08.755019 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:06:08.765772 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:06:08.776410 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:06:08.896916 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:06:09.017136 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:06:09.136293 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:06:09.251187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:09.718042 run create_hlr_db(pid=5224): Launched 10:06:09.835955 bus /sierra_2: Setting Powered False 10:06:10.895774 run create_hlr_db(pid=5224): Terminated: ok {rc=0} 10:06:11.339755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5226): Launched 10:06:11.664663 run osmo-hlr_10.42.42.2(pid=5227): Launched 10:06:11.788272 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:12.341936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5229): Launched 10:06:12.666103 run osmo-stp_10.42.42.5(pid=5230): Launched 10:06:12.798833 tst emergency_preemptive_call.py: using MSISDN 8633 10:06:12.963293 run osmo-msc_10.42.42.6: Starting osmo-msc 10:06:13.541566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5232): Launched 10:06:13.864047 run osmo-msc_10.42.42.6(pid=5233): Launched 10:06:14.044266 run osmo-stp_10.42.42.5(pid=5230): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5230)] 10:06:14.179482 run osmo-stp_10.42.42.5(pid=5230): stdout: | (launched: 2022-12-14_10:06:12.606921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:14.315489 run osmo-stp_10.42.42.5(pid=5230): stderr: | 20221214100612797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100612797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100612798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100612798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100612798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100612799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100612799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:14.450488 run osmo-stp_10.42.42.5(pid=5230): stdout: | (launched: 2022-12-14_10:06:12.606921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:14.578455 run osmo-stp_10.42.42.5(pid=5230): stderr: | 20221214100612797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100612797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100612798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100612798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100612798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100612799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100612799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:14.731324 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5230): Process ended prematurely: osmo-stp_10.42.42.5(pid=5230) [trial-2403↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5230)] [trial-2403↪emergency:oc2g↪emergency_preemptive_call.py:32] 10:06:14.740382 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 10:06:14.768437 run osmo-hlr_10.42.42.2(pid=5227): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5227)] 10:06:14.819022 run osmo-hlr_10.42.42.2(pid=5227): stdout: | (launched: 2022-12-14_10:06:11.605391) 10:06:14.871468 run osmo-hlr_10.42.42.2(pid=5227): stderr: | 20221214100611803 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100611803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100611803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100611803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100611803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100611803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100611833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100611843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100611843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100611844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:14.944834 run osmo-msc_10.42.42.6(pid=5233): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5233)] 10:06:14.995540 run osmo-msc_10.42.42.6(pid=5233): stdout: | (launched: 2022-12-14_10:06:13.805220) 10:06:15.048363 run osmo-msc_10.42.42.6(pid=5233): stderr: | 20221214100614125 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214100614125 DLGLOBAL DEBUG validating counter group 0x7f793ddafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214100614125 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214100614125 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214100614125 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214100614126 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214100614127 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214100614128 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214100614128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214100614128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:06:15.101053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5226): Terminating (SIGTERM) 10:06:15.143295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5229): Terminating (SIGTERM) 10:06:15.186155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5232): Terminating (SIGTERM) 10:06:15.228553 --- ParallelTerminationStrategy: PID 5226 died... 10:06:15.248883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5226): Terminated: ok {rc=0} 10:06:15.295420 --- ParallelTerminationStrategy: PID 5229 died... 10:06:15.315254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5229): Terminated: ok {rc=0} 10:06:15.361635 --- ParallelTerminationStrategy: PID 5232 died... 10:06:15.381498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5232): Terminated: ok {rc=0} 10:06:15.470555 bus /sierra_9: Setting Powered False 10:06:16.567320 bus /sierra_9: Setting Powered False 10:06:17.686579 bus /sierra_8: Setting Powered False 10:06:18.786248 bus /sierra_8: Setting Powered False 10:06:19.902381 bus /sierra_3: Setting Powered False 10:06:21.001188 bus /sierra_3: Setting Powered False 10:06:22.119385 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:oc2g --------------------------------------------------------------------- 10:06:23.380391 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:06:23.384759 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 10:06:23.405134 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 10:06:23.443908 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 10:06:23.531984 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 10:06:23.554259 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 10:06:23.593718 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 10:06:24.176629 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 10:06:24.232023 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:24.243194 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:06:24.279685 tst cs_paging_gprs_active.py: using LAC 40180 10:06:24.414320 tst cs_paging_gprs_active.py: using RAC 145 10:06:24.543405 tst cs_paging_gprs_active.py: using CellId 40180 10:06:24.671216 tst cs_paging_gprs_active.py: using BVCI 40181 10:06:24.790595 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:24.801585 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:24.812279 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:24.823151 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:24.834021 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:24.844901 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:24.855944 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:24.866914 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:24.878104 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:06:24.997792 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:06:25.118809 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:06:25.341174 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:25.657168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5238): Launched 10:06:25.927376 run iperf3-srv_10.42.42.10(pid=5239): Launched 10:06:26.043652 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:06:26.250326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:26.560010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5240): Launched 10:06:26.829554 run iperf3-srv_10.42.42.10(pid=5241): Launched 10:06:26.946046 tst cs_paging_gprs_active.py:38: start network... 10:06:27.151866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:27.627401 run create_hlr_db(pid=5242): Launched 10:06:27.746674 bus /sierra_2: Setting Powered False 10:06:28.808016 run create_hlr_db(pid=5242): Terminated: ok {rc=0} 10:06:29.256544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5244): Launched 10:06:29.585101 run osmo-hlr_10.42.42.2(pid=5245): Launched 10:06:29.712534 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:30.284347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5247): Launched 10:06:30.615151 run osmo-stp_10.42.42.5(pid=5248): Launched 10:06:30.741833 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:06:31.371814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5250): Launched 10:06:31.500810 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:06:31.769819 run patchelf(pid=5251): Launched 10:06:31.978547 run osmo-stp_10.42.42.5(pid=5248): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5248)] 10:06:32.116197 run osmo-stp_10.42.42.5(pid=5248): stdout: | (launched: 2022-12-14_10:06:30.555336) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:32.254016 run osmo-stp_10.42.42.5(pid=5248): stderr: | 20221214100630745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100630746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100630746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100630746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100630747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100630747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100630747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:32.391774 run osmo-stp_10.42.42.5(pid=5248): stdout: | (launched: 2022-12-14_10:06:30.555336) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:32.519546 run osmo-stp_10.42.42.5(pid=5248): stderr: | 20221214100630745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100630746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100630746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100630746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100630747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100630747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100630747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:32.669360 run patchelf(pid=5251): Terminating (SIGINT) 10:06:32.844435 run patchelf(pid=5251): Terminated: ok {rc=0} 10:06:32.969946 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5248): Process ended prematurely: osmo-stp_10.42.42.5(pid=5248) [trial-2403↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5248)] [trial-2403↪gprs:oc2g↪cs_paging_gprs_active.py:38] 10:06:32.979584 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:06:33.007349 run osmo-hlr_10.42.42.2(pid=5245): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5245)] 10:06:33.056745 run osmo-hlr_10.42.42.2(pid=5245): stdout: | (launched: 2022-12-14_10:06:29.525049) 10:06:33.107392 run osmo-hlr_10.42.42.2(pid=5245): stderr: | 20221214100629721 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100629721 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100629721 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100629721 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100629721 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100629722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100629734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100629744 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100629744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100629745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:33.158460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5238): Terminating (SIGTERM) 10:06:33.199369 run iperf3-srv_10.42.42.10(pid=5239): Terminating (SIGTERM) 10:06:33.240717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5240): Terminating (SIGTERM) 10:06:33.282309 run iperf3-srv_10.42.42.10(pid=5241): Terminating (SIGTERM) 10:06:33.323065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5244): Terminating (SIGTERM) 10:06:33.364500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5247): Terminating (SIGTERM) 10:06:33.405648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5250): Terminating (SIGTERM) 10:06:33.447178 --- ParallelTerminationStrategy: PID 5238 died... 10:06:33.467214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5238): Terminated: ok {rc=0} 10:06:33.512175 --- ParallelTerminationStrategy: PID 5239 died... 10:06:33.531427 run iperf3-srv_10.42.42.10(pid=5239): Terminated {rc=256} 10:06:33.576255 --- ParallelTerminationStrategy: PID 5240 died... 10:06:33.595541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5240): Terminated: ok {rc=0} 10:06:33.640023 --- ParallelTerminationStrategy: PID 5241 died... 10:06:33.659191 run iperf3-srv_10.42.42.10(pid=5241): Terminated {rc=256} 10:06:33.703843 --- ParallelTerminationStrategy: PID 5244 died... 10:06:33.723071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5244): Terminated: ok {rc=0} 10:06:33.767621 --- ParallelTerminationStrategy: PID 5247 died... 10:06:33.786875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5247): Terminated: ok {rc=0} 10:06:33.831466 --- ParallelTerminationStrategy: PID 5250 died... 10:06:33.850762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5250): Terminated: ok {rc=0} 10:06:33.936146 bus /gobi_0: Setting Powered False 10:06:35.035593 bus /gobi_0: Setting Powered False 10:06:36.153212 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g iperf3.py ---------------------------------------------- 10:06:37.297734 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:37.308737 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:06:37.344587 tst iperf3.py: using LAC 40181 10:06:37.464521 tst iperf3.py: using RAC 146 10:06:37.586488 tst iperf3.py: using CellId 40181 10:06:37.715986 tst iperf3.py: using BVCI 40182 10:06:37.827961 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:37.838511 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:37.849208 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:37.859480 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:37.870110 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:37.881200 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:37.892029 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:37.905930 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:37.917683 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:06:38.040760 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:06:38.262670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:38.592638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5252): Launched 10:06:38.879007 run iperf3-srv_10.42.42.10(pid=5253): Launched 10:06:39.003573 tst iperf3.py:8: start network... 10:06:39.225138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:39.733501 run create_hlr_db(pid=5254): Launched 10:06:39.868629 bus /gobi_6: Setting Powered False 10:06:40.934003 run create_hlr_db(pid=5254): Terminated: ok {rc=0} 10:06:41.392028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5256): Launched 10:06:41.720320 run osmo-hlr_10.42.42.2(pid=5257): Launched 10:06:41.845480 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:42.415519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5259): Launched 10:06:42.746543 run osmo-stp_10.42.42.5(pid=5260): Launched 10:06:42.872895 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:06:43.440013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5262): Launched 10:06:43.568573 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:06:43.845939 run patchelf(pid=5263): Launched 10:06:44.030618 run osmo-stp_10.42.42.5(pid=5260): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5260)] 10:06:44.169515 run osmo-stp_10.42.42.5(pid=5260): stdout: | (launched: 2022-12-14_10:06:42.686679) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:44.310144 run osmo-stp_10.42.42.5(pid=5260): stderr: | 20221214100642875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100642876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100642876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100642876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100642877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100642877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100642877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:44.450396 run osmo-stp_10.42.42.5(pid=5260): stdout: | (launched: 2022-12-14_10:06:42.686679) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:44.584672 run osmo-stp_10.42.42.5(pid=5260): stderr: | 20221214100642875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100642876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100642876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100642876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100642877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100642877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100642877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:44.744172 run patchelf(pid=5263): Terminating (SIGINT) 10:06:44.928757 run patchelf(pid=5263): Terminated: ok {rc=0} 10:06:45.062521 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5260): Process ended prematurely: osmo-stp_10.42.42.5(pid=5260) [trial-2403↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5260)] [trial-2403↪gprs:oc2g↪iperf3.py:8] 10:06:45.073014 tst iperf3.py:8: Test FAILED (7.8 sec) 10:06:45.101925 run osmo-hlr_10.42.42.2(pid=5257): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5257)] 10:06:45.152541 run osmo-hlr_10.42.42.2(pid=5257): stdout: | (launched: 2022-12-14_10:06:41.660443) 10:06:45.204814 run osmo-hlr_10.42.42.2(pid=5257): stderr: | 20221214100641856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100641857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100641857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100641857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100641857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100641857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100641870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100641879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100641879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100641879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:45.257624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5252): Terminating (SIGTERM) 10:06:45.299947 run iperf3-srv_10.42.42.10(pid=5253): Terminating (SIGTERM) 10:06:45.342302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5256): Terminating (SIGTERM) 10:06:45.384663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5259): Terminating (SIGTERM) 10:06:45.427504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5262): Terminating (SIGTERM) 10:06:45.470313 --- ParallelTerminationStrategy: PID 5252 died... 10:06:45.490893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5252): Terminated: ok {rc=0} 10:06:45.537651 --- ParallelTerminationStrategy: PID 5253 died... 10:06:45.557497 run iperf3-srv_10.42.42.10(pid=5253): Terminated {rc=256} 10:06:45.603808 --- ParallelTerminationStrategy: PID 5256 died... 10:06:45.623806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5256): Terminated: ok {rc=0} 10:06:45.670976 --- ParallelTerminationStrategy: PID 5259 died... 10:06:45.690994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5259): Terminated: ok {rc=0} 10:06:45.737538 --- ParallelTerminationStrategy: PID 5262 died... 10:06:45.757444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5262): Terminated: ok {rc=0} 10:06:45.846651 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g iperf3m4.py ---------------------------------------------- 10:06:47.008263 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:47.020579 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:06:47.056517 tst iperf3m4.py: using LAC 40182 10:06:47.182769 tst iperf3m4.py: using RAC 147 10:06:47.306229 tst iperf3m4.py: using CellId 40182 10:06:47.435087 tst iperf3m4.py: using BVCI 40183 10:06:47.548571 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:47.559353 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:47.570053 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:47.580553 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:47.591532 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:47.602380 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:47.613468 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:47.624200 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:06:47.635133 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:06:47.752533 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:06:47.876030 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:06:47.992155 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:06:48.111237 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:06:48.332803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:48.664901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5264): Launched 10:06:48.951954 run iperf3-srv_10.42.42.10(pid=5265): Launched 10:06:49.076420 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:06:49.297408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:49.628485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5266): Launched 10:06:49.916315 run iperf3-srv_10.42.42.10(pid=5267): Launched 10:06:50.040048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:06:50.261162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:50.590908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5268): Launched 10:06:50.879282 run iperf3-srv_10.42.42.10(pid=5269): Launched 10:06:51.003664 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:06:51.224784 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:06:51.554149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5270): Launched 10:06:51.840465 run iperf3-srv_10.42.42.10(pid=5271): Launched 10:06:51.963694 tst iperf3m4.py:8: start network... 10:06:52.185190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:52.694792 run create_hlr_db(pid=5272): Launched 10:06:52.830478 bus /gobi_6: Setting Powered False 10:06:53.895672 run create_hlr_db(pid=5272): Terminated: ok {rc=0} 10:06:54.335769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5274): Launched 10:06:54.645928 run osmo-hlr_10.42.42.2(pid=5275): Launched 10:06:54.765460 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:55.307314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5277): Launched 10:06:55.618676 run osmo-stp_10.42.42.5(pid=5278): Launched 10:06:55.738996 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:06:56.268904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5280): Launched 10:06:56.387644 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:06:56.647847 run patchelf(pid=5281): Launched 10:06:56.822482 run osmo-stp_10.42.42.5(pid=5278): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5278)] 10:06:56.952725 run osmo-stp_10.42.42.5(pid=5278): stdout: | (launched: 2022-12-14_10:06:55.561602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:57.085301 run osmo-stp_10.42.42.5(pid=5278): stderr: | 20221214100655734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100655735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100655735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100655735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100655736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100655736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100655736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:57.217858 run osmo-stp_10.42.42.5(pid=5278): stdout: | (launched: 2022-12-14_10:06:55.561602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:57.344158 run osmo-stp_10.42.42.5(pid=5278): stderr: | 20221214100655734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100655735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100655735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100655735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100655736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100655736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100655736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:57.493544 run patchelf(pid=5281): Terminating (SIGINT) 10:06:57.667349 run patchelf(pid=5281): Terminated: ok {rc=0} 10:06:57.793571 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5278): Process ended prematurely: osmo-stp_10.42.42.5(pid=5278) [trial-2403↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5278)] [trial-2403↪gprs:oc2g↪iperf3m4.py:8] 10:06:57.803504 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:06:57.831603 run osmo-hlr_10.42.42.2(pid=5275): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5275)] 10:06:57.880923 run osmo-hlr_10.42.42.2(pid=5275): stdout: | (launched: 2022-12-14_10:06:54.589058) 10:06:57.931535 run osmo-hlr_10.42.42.2(pid=5275): stderr: | 20221214100654764 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100654764 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100654764 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100654764 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100654764 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100654764 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100654777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100654785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100654785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100654785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:57.982411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5264): Terminating (SIGTERM) 10:06:58.023376 run iperf3-srv_10.42.42.10(pid=5265): Terminating (SIGTERM) 10:06:58.064083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5266): Terminating (SIGTERM) 10:06:58.105037 run iperf3-srv_10.42.42.10(pid=5267): Terminating (SIGTERM) 10:06:58.146065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5268): Terminating (SIGTERM) 10:06:58.186840 run iperf3-srv_10.42.42.10(pid=5269): Terminating (SIGTERM) 10:06:58.227307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5270): Terminating (SIGTERM) 10:06:58.268284 run iperf3-srv_10.42.42.10(pid=5271): Terminating (SIGTERM) 10:06:58.310610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5274): Terminating (SIGTERM) 10:06:58.351367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5277): Terminating (SIGTERM) 10:06:58.391549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5280): Terminating (SIGTERM) 10:06:58.431886 --- ParallelTerminationStrategy: PID 5264 died... 10:06:58.451579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5264): Terminated: ok {rc=0} 10:06:58.496068 --- ParallelTerminationStrategy: PID 5265 died... 10:06:58.515104 run iperf3-srv_10.42.42.10(pid=5265): Terminated {rc=256} 10:06:58.559423 --- ParallelTerminationStrategy: PID 5266 died... 10:06:58.578535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5266): Terminated: ok {rc=0} 10:06:58.622877 --- ParallelTerminationStrategy: PID 5267 died... 10:06:58.641880 run iperf3-srv_10.42.42.10(pid=5267): Terminated {rc=256} 10:06:58.686022 --- ParallelTerminationStrategy: PID 5268 died... 10:06:58.705261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5268): Terminated: ok {rc=0} 10:06:58.749575 --- ParallelTerminationStrategy: PID 5269 died... 10:06:58.768498 run iperf3-srv_10.42.42.10(pid=5269): Terminated {rc=256} 10:06:58.812760 --- ParallelTerminationStrategy: PID 5270 died... 10:06:58.831952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5270): Terminated: ok {rc=0} 10:06:58.876202 --- ParallelTerminationStrategy: PID 5271 died... 10:06:58.895277 run iperf3-srv_10.42.42.10(pid=5271): Terminated {rc=256} 10:06:58.939479 --- ParallelTerminationStrategy: PID 5274 died... 10:06:58.958667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5274): Terminated: ok {rc=0} 10:06:59.002867 --- ParallelTerminationStrategy: PID 5277 died... 10:06:59.022166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5277): Terminated: ok {rc=0} 10:06:59.066464 --- ParallelTerminationStrategy: PID 5280 died... 10:06:59.085654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5280): Terminated: ok {rc=0} 10:06:59.172321 bus /gobi_4: Setting Powered False 10:07:00.272398 bus /gobi_4: Setting Powered False 10:07:01.396011 bus /gobi_1: Setting Powered False 10:07:02.498557 bus /gobi_1: Setting Powered False 10:07:03.614715 bus /gobi_0: Setting Powered False 10:07:04.713317 bus /gobi_0: Setting Powered False 10:07:05.831957 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g ping.py ---------------------------------------------- 10:07:06.938959 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:06.950792 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:07:06.986755 tst ping.py: using LAC 40183 10:07:07.115883 tst ping.py: using RAC 148 10:07:07.241217 tst ping.py: using CellId 40183 10:07:07.367412 tst ping.py: using BVCI 40184 10:07:07.483987 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:07.495119 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:07.506112 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:07.516893 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:07.527696 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:07.538486 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:07.549479 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:07.560560 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:07:07.677992 tst ping.py:19: start network... 10:07:07.882242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:08.348345 run create_hlr_db(pid=5283): Launched 10:07:08.463487 bus /gobi_6: Setting Powered False 10:07:09.523363 run create_hlr_db(pid=5283): Terminated: ok {rc=0} 10:07:09.964427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5285): Launched 10:07:10.289740 run osmo-hlr_10.42.42.2(pid=5286): Launched 10:07:10.414886 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:10.970952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5288): Launched 10:07:11.297161 run osmo-stp_10.42.42.5(pid=5289): Launched 10:07:11.420017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:07:11.977266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5291): Launched 10:07:12.102828 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:07:12.375031 run patchelf(pid=5292): Launched 10:07:12.556328 run osmo-stp_10.42.42.5(pid=5289): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5289)] 10:07:12.692743 run osmo-stp_10.42.42.5(pid=5289): stdout: | (launched: 2022-12-14_10:07:11.238108) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:12.831659 run osmo-stp_10.42.42.5(pid=5289): stderr: | 20221214100711429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100711429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100711429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100711430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100711430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100711430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100711430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:12.970641 run osmo-stp_10.42.42.5(pid=5289): stdout: | (launched: 2022-12-14_10:07:11.238108) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:13.103502 run osmo-stp_10.42.42.5(pid=5289): stderr: | 20221214100711429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100711429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100711429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100711430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100711430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100711430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100711430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:13.259989 run patchelf(pid=5292): Terminating (SIGINT) 10:07:13.440920 run patchelf(pid=5292): Terminated: ok {rc=0} 10:07:13.571450 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5289): Process ended prematurely: osmo-stp_10.42.42.5(pid=5289) [trial-2403↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5289)] [trial-2403↪gprs:oc2g↪ping.py:22] 10:07:13.581368 tst ping.py:22: Test FAILED (6.6 sec) 10:07:13.610154 run osmo-hlr_10.42.42.2(pid=5286): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5286)] 10:07:13.661144 run osmo-hlr_10.42.42.2(pid=5286): stdout: | (launched: 2022-12-14_10:07:10.230739) 10:07:13.713941 run osmo-hlr_10.42.42.2(pid=5286): stderr: | 20221214100710427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100710427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100710427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100710427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100710427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100710427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100710443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100710452 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100710453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100710453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:13.766980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5285): Terminating (SIGTERM) 10:07:13.809783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5288): Terminating (SIGTERM) 10:07:13.852564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5291): Terminating (SIGTERM) 10:07:13.895948 --- ParallelTerminationStrategy: PID 5285 died... 10:07:13.916695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5285): Terminated: ok {rc=0} 10:07:13.963714 --- ParallelTerminationStrategy: PID 5288 died... 10:07:13.983588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5288): Terminated: ok {rc=0} 10:07:14.030520 --- ParallelTerminationStrategy: PID 5291 died... 10:07:14.050741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5291): Terminated: ok {rc=0} 10:07:14.139306 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 10:07:15.226417 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:15.238181 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:07:15.276061 tst ping_idle_ping.py: using LAC 40184 10:07:15.400757 tst ping_idle_ping.py: using RAC 149 10:07:15.518177 tst ping_idle_ping.py: using CellId 40184 10:07:15.637117 tst ping_idle_ping.py: using BVCI 40185 10:07:15.746634 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:15.757182 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:15.767623 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:15.778083 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:15.788691 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:15.799754 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:15.810526 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:07:15.821331 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:07:15.952162 tst ping_idle_ping.py:24: start network... 10:07:16.183032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:16.694652 run create_hlr_db(pid=5293): Launched 10:07:16.834203 bus /gobi_6: Setting Powered False 10:07:17.894607 run create_hlr_db(pid=5293): Terminated: ok {rc=0} 10:07:18.337577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5295): Launched 10:07:18.663308 run osmo-hlr_10.42.42.2(pid=5296): Launched 10:07:18.787381 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:19.348939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5298): Launched 10:07:19.673021 run osmo-stp_10.42.42.5(pid=5299): Launched 10:07:19.796709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:07:20.353001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5301): Launched 10:07:20.477972 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:07:20.750514 run patchelf(pid=5302): Launched 10:07:20.932715 run osmo-stp_10.42.42.5(pid=5299): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5299)] 10:07:21.070158 run osmo-stp_10.42.42.5(pid=5299): stdout: | (launched: 2022-12-14_10:07:19.614113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:21.209136 run osmo-stp_10.42.42.5(pid=5299): stderr: | 20221214100719806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100719806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100719806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100719807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100719807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100719807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100719807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:21.347861 run osmo-stp_10.42.42.5(pid=5299): stdout: | (launched: 2022-12-14_10:07:19.614113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:21.480099 run osmo-stp_10.42.42.5(pid=5299): stderr: | 20221214100719806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100719806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100719806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100719807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100719807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100719807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100719807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:21.636638 run patchelf(pid=5302): Terminating (SIGINT) 10:07:21.818441 run patchelf(pid=5302): Terminated: ok {rc=0} 10:07:21.949475 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5299): Process ended prematurely: osmo-stp_10.42.42.5(pid=5299) [trial-2403↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5299)] [trial-2403↪gprs:oc2g↪ping_idle_ping.py:27] 10:07:21.959256 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:07:21.987924 run osmo-hlr_10.42.42.2(pid=5296): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5296)] 10:07:22.038307 run osmo-hlr_10.42.42.2(pid=5296): stdout: | (launched: 2022-12-14_10:07:18.603582) 10:07:22.091063 run osmo-hlr_10.42.42.2(pid=5296): stderr: | 20221214100718799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100718799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100718800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100718800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100718800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100718800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100718813 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100718822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100718822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100718822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:22.143721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5295): Terminating (SIGTERM) 10:07:22.185758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5298): Terminating (SIGTERM) 10:07:22.227826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5301): Terminating (SIGTERM) 10:07:22.270311 --- ParallelTerminationStrategy: PID 5295 died... 10:07:22.290823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5295): Terminated: ok {rc=0} 10:07:22.337387 --- ParallelTerminationStrategy: PID 5298 died... 10:07:22.357196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5298): Terminated: ok {rc=0} 10:07:22.403422 --- ParallelTerminationStrategy: PID 5301 died... 10:07:22.423220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5301): Terminated: ok {rc=0} 10:07:22.511269 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 10:07:23.804326 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:07:23.810036 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:07:23.830879 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:07:23.871154 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:07:23.961896 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:07:23.983962 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:07:24.022423 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:07:24.609562 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:07:24.658572 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:24.669415 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:07:24.704880 tst cs_paging_gprs_active.py: using LAC 40185 10:07:24.824722 tst cs_paging_gprs_active.py: using RAC 150 10:07:24.943905 tst cs_paging_gprs_active.py: using CellId 40185 10:07:25.062314 tst cs_paging_gprs_active.py: using BVCI 40186 10:07:25.174116 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:25.184711 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:25.195220 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:25.205656 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:25.216420 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:25.227065 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:25.238771 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:25.249596 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:25.260514 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:07:25.379198 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:07:25.497202 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:07:25.714476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:26.038291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5307): Launched 10:07:26.318350 run iperf3-srv_10.42.42.10(pid=5308): Launched 10:07:26.440881 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:07:26.656420 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:26.979382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5309): Launched 10:07:27.260377 run iperf3-srv_10.42.42.10(pid=5310): Launched 10:07:27.381380 tst cs_paging_gprs_active.py:38: start network... 10:07:27.597277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:28.097145 run create_hlr_db(pid=5311): Launched 10:07:28.228543 bus /gobi_6: Setting Powered False 10:07:29.292683 run create_hlr_db(pid=5311): Terminated: ok {rc=0} 10:07:29.725950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5313): Launched 10:07:30.029774 run osmo-hlr_10.42.42.2(pid=5314): Launched 10:07:30.145562 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:30.666673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5316): Launched 10:07:30.998358 run osmo-stp_10.42.42.5(pid=5317): Launched 10:07:31.380116 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:07:32.085658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5319): Launched 10:07:32.230198 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:07:32.489107 run patchelf(pid=5320): Launched 10:07:32.658736 run osmo-stp_10.42.42.5(pid=5317): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5317)] 10:07:32.787738 run osmo-stp_10.42.42.5(pid=5317): stdout: | (launched: 2022-12-14_10:07:30.936359) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:32.917908 run osmo-stp_10.42.42.5(pid=5317): stderr: | 20221214100731253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100731254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100731255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100731255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100731258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100731258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100731258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:33.048717 run osmo-stp_10.42.42.5(pid=5317): stdout: | (launched: 2022-12-14_10:07:30.936359) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:33.172524 run osmo-stp_10.42.42.5(pid=5317): stderr: | 20221214100731253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100731254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100731255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100731255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100731258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100731258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100731258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:33.319707 run patchelf(pid=5320): Terminating (SIGINT) 10:07:33.490262 run patchelf(pid=5320): Terminated: ok {rc=0} 10:07:33.613176 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5317): Process ended prematurely: osmo-stp_10.42.42.5(pid=5317) [trial-2403↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5317)] [trial-2403↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:07:33.622915 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 10:07:33.650095 run osmo-hlr_10.42.42.2(pid=5314): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5314)] 10:07:33.698226 run osmo-hlr_10.42.42.2(pid=5314): stdout: | (launched: 2022-12-14_10:07:29.974220) 10:07:33.747533 run osmo-hlr_10.42.42.2(pid=5314): stderr: | 20221214100730149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100730149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100730149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100730149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100730149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100730149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100730161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100730169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100730170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100730170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:33.798131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5307): Terminating (SIGTERM) 10:07:33.839146 run iperf3-srv_10.42.42.10(pid=5308): Terminating (SIGTERM) 10:07:33.879586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5309): Terminating (SIGTERM) 10:07:33.920009 run iperf3-srv_10.42.42.10(pid=5310): Terminating (SIGTERM) 10:07:33.960867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5313): Terminating (SIGTERM) 10:07:34.001663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5316): Terminating (SIGTERM) 10:07:34.042221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5319): Terminating (SIGTERM) 10:07:34.082906 --- ParallelTerminationStrategy: PID 5307 died... 10:07:34.102675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5307): Terminated: ok {rc=0} 10:07:34.147098 --- ParallelTerminationStrategy: PID 5308 died... 10:07:34.166104 run iperf3-srv_10.42.42.10(pid=5308): Terminated {rc=256} 10:07:34.210079 --- ParallelTerminationStrategy: PID 5309 died... 10:07:34.229086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5309): Terminated: ok {rc=0} 10:07:34.273085 --- ParallelTerminationStrategy: PID 5310 died... 10:07:34.291998 run iperf3-srv_10.42.42.10(pid=5310): Terminated {rc=256} 10:07:34.335845 --- ParallelTerminationStrategy: PID 5313 died... 10:07:34.354832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5313): Terminated: ok {rc=0} 10:07:34.398945 --- ParallelTerminationStrategy: PID 5316 died... 10:07:34.418101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5316): Terminated: ok {rc=0} 10:07:34.462402 --- ParallelTerminationStrategy: PID 5319 died... 10:07:34.481825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5319): Terminated: ok {rc=0} 10:07:34.568890 bus /gobi_0: Setting Powered False 10:07:35.668507 bus /gobi_0: Setting Powered False 10:07:36.787259 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:07:37.935850 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:37.947629 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:07:37.984721 tst iperf3.py: using LAC 40186 10:07:38.104232 tst iperf3.py: using RAC 151 10:07:38.223944 tst iperf3.py: using CellId 40186 10:07:38.343343 tst iperf3.py: using BVCI 40187 10:07:38.454005 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:38.464727 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:38.475482 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:38.486008 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:38.496755 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:38.507587 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:38.518565 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:38.529431 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:38.540297 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:07:38.658682 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:07:38.860839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:39.164895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5321): Launched 10:07:39.427621 run iperf3-srv_10.42.42.10(pid=5322): Launched 10:07:39.541334 tst iperf3.py:8: start network... 10:07:39.742235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:40.207714 run create_hlr_db(pid=5323): Launched 10:07:40.322930 bus /gobi_6: Setting Powered False 10:07:41.382506 run create_hlr_db(pid=5323): Terminated: ok {rc=0} 10:07:41.822088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5325): Launched 10:07:42.144382 run osmo-hlr_10.42.42.2(pid=5326): Launched 10:07:42.268073 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:42.824652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5328): Launched 10:07:43.146992 run osmo-stp_10.42.42.5(pid=5329): Launched 10:07:43.271845 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:07:43.825799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5331): Launched 10:07:43.950499 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:07:44.222195 run patchelf(pid=5332): Launched 10:07:44.402960 run osmo-stp_10.42.42.5(pid=5329): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5329)] 10:07:44.539147 run osmo-stp_10.42.42.5(pid=5329): stdout: | (launched: 2022-12-14_10:07:43.087974) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:44.677552 run osmo-stp_10.42.42.5(pid=5329): stderr: | 20221214100743277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100743277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100743278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100743278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100743278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100743278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100743278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:44.815523 run osmo-stp_10.42.42.5(pid=5329): stdout: | (launched: 2022-12-14_10:07:43.087974) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:44.947500 run osmo-stp_10.42.42.5(pid=5329): stderr: | 20221214100743277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100743277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100743278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100743278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100743278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100743278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100743278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:45.104484 run patchelf(pid=5332): Terminating (SIGINT) 10:07:45.284816 run patchelf(pid=5332): Terminated: ok {rc=0} 10:07:45.415534 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5329): Process ended prematurely: osmo-stp_10.42.42.5(pid=5329) [trial-2403↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5329)] [trial-2403↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 10:07:45.425925 tst iperf3.py:8: Test FAILED (7.5 sec) 10:07:45.454570 run osmo-hlr_10.42.42.2(pid=5326): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5326)] 10:07:45.504905 run osmo-hlr_10.42.42.2(pid=5326): stdout: | (launched: 2022-12-14_10:07:42.085909) 10:07:45.557062 run osmo-hlr_10.42.42.2(pid=5326): stderr: | 20221214100742282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100742282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100742282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100742282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100742282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100742282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100742296 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100742304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100742304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100742304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:45.609613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5321): Terminating (SIGTERM) 10:07:45.651560 run iperf3-srv_10.42.42.10(pid=5322): Terminating (SIGTERM) 10:07:45.694130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5325): Terminating (SIGTERM) 10:07:45.736633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5328): Terminating (SIGTERM) 10:07:45.778551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5331): Terminating (SIGTERM) 10:07:45.821259 --- ParallelTerminationStrategy: PID 5321 died... 10:07:45.852908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5321): Terminated: ok {rc=0} 10:07:45.916538 --- ParallelTerminationStrategy: PID 5322 died... 10:07:45.937310 run iperf3-srv_10.42.42.10(pid=5322): Terminated {rc=256} 10:07:45.985096 --- ParallelTerminationStrategy: PID 5325 died... 10:07:46.006017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5325): Terminated: ok {rc=0} 10:07:46.053189 --- ParallelTerminationStrategy: PID 5328 died... 10:07:46.074389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5328): Terminated: ok {rc=0} 10:07:46.122815 --- ParallelTerminationStrategy: PID 5331 died... 10:07:46.143663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5331): Terminated: ok {rc=0} 10:07:46.233606 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:07:47.379090 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:47.390719 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:07:47.427075 tst iperf3m4.py: using LAC 40187 10:07:47.554680 tst iperf3m4.py: using RAC 152 10:07:47.693585 tst iperf3m4.py: using CellId 40187 10:07:47.829241 tst iperf3m4.py: using BVCI 40188 10:07:47.946663 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:47.957908 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:47.968927 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:47.980058 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:47.991460 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:48.002924 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:48.014690 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:48.026086 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:07:48.037760 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:07:48.161408 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:07:48.278923 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:07:48.399719 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:07:48.517871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:07:48.733678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:49.057296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5333): Launched 10:07:49.338065 run iperf3-srv_10.42.42.10(pid=5335): Launched 10:07:49.459900 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:07:49.675045 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:49.997886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5336): Launched 10:07:50.279289 run iperf3-srv_10.42.42.10(pid=5337): Launched 10:07:50.399824 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:07:50.614533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:50.936881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5338): Launched 10:07:51.218369 run iperf3-srv_10.42.42.10(pid=5339): Launched 10:07:51.340845 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:07:51.556232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:07:51.879070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5340): Launched 10:07:52.178989 run iperf3-srv_10.42.42.10(pid=5341): Launched 10:07:52.292842 tst iperf3m4.py:8: start network... 10:07:52.494749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:52.961779 run create_hlr_db(pid=5342): Launched 10:07:53.077436 bus /gobi_6: Setting Powered False 10:07:54.137713 run create_hlr_db(pid=5342): Terminated: ok {rc=0} 10:07:54.561110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5344): Launched 10:07:54.863806 run osmo-hlr_10.42.42.2(pid=5345): Launched 10:07:54.979021 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:55.502711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5347): Launched 10:07:55.808197 run osmo-stp_10.42.42.5(pid=5348): Launched 10:07:55.924172 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:07:56.449929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5350): Launched 10:07:56.568152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:07:56.824176 run patchelf(pid=5351): Launched 10:07:56.993253 run osmo-stp_10.42.42.5(pid=5348): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5348)] 10:07:57.121817 run osmo-stp_10.42.42.5(pid=5348): stdout: | (launched: 2022-12-14_10:07:55.752519) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:57.252298 run osmo-stp_10.42.42.5(pid=5348): stderr: | 20221214100755921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100755921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100755921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100755922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100755922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100755922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100755922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:57.382671 run osmo-stp_10.42.42.5(pid=5348): stdout: | (launched: 2022-12-14_10:07:55.752519) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:57.507521 run osmo-stp_10.42.42.5(pid=5348): stderr: | 20221214100755921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100755921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100755921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100755922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100755922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100755922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100755922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:57.654312 run patchelf(pid=5351): Terminating (SIGINT) 10:07:57.824805 run patchelf(pid=5351): Terminated: ok {rc=0} 10:07:57.948353 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5348): Process ended prematurely: osmo-stp_10.42.42.5(pid=5348) [trial-2403↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5348)] [trial-2403↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 10:07:57.958167 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:07:57.985853 run osmo-hlr_10.42.42.2(pid=5345): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5345)] 10:07:58.034341 run osmo-hlr_10.42.42.2(pid=5345): stdout: | (launched: 2022-12-14_10:07:54.808322) 10:07:58.084242 run osmo-hlr_10.42.42.2(pid=5345): stderr: | 20221214100754981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100754981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100754981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100754981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100754981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100754981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100754993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100755001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100755001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100755001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:58.135048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5333): Terminating (SIGTERM) 10:07:58.174944 run iperf3-srv_10.42.42.10(pid=5335): Terminating (SIGTERM) 10:07:58.215673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5336): Terminating (SIGTERM) 10:07:58.256445 run iperf3-srv_10.42.42.10(pid=5337): Terminating (SIGTERM) 10:07:58.297024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5338): Terminating (SIGTERM) 10:07:58.337697 run iperf3-srv_10.42.42.10(pid=5339): Terminating (SIGTERM) 10:07:58.378578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5340): Terminating (SIGTERM) 10:07:58.419378 run iperf3-srv_10.42.42.10(pid=5341): Terminating (SIGTERM) 10:07:58.459991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5344): Terminating (SIGTERM) 10:07:58.500675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5347): Terminating (SIGTERM) 10:07:58.541213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5350): Terminating (SIGTERM) 10:07:58.581981 --- ParallelTerminationStrategy: PID 5333 died... 10:07:58.601630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5333): Terminated: ok {rc=0} 10:07:58.646480 --- ParallelTerminationStrategy: PID 5335 died... 10:07:58.665615 run iperf3-srv_10.42.42.10(pid=5335): Terminated {rc=256} 10:07:58.710114 --- ParallelTerminationStrategy: PID 5336 died... 10:07:58.729287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5336): Terminated: ok {rc=0} 10:07:58.773779 --- ParallelTerminationStrategy: PID 5337 died... 10:07:58.792848 run iperf3-srv_10.42.42.10(pid=5337): Terminated {rc=256} 10:07:58.837224 --- ParallelTerminationStrategy: PID 5338 died... 10:07:58.856016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5338): Terminated: ok {rc=0} 10:07:58.900402 --- ParallelTerminationStrategy: PID 5339 died... 10:07:58.919525 run iperf3-srv_10.42.42.10(pid=5339): Terminated {rc=256} 10:07:58.963934 --- ParallelTerminationStrategy: PID 5340 died... 10:07:58.983007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5340): Terminated: ok {rc=0} 10:07:59.027470 --- ParallelTerminationStrategy: PID 5341 died... 10:07:59.046508 run iperf3-srv_10.42.42.10(pid=5341): Terminated {rc=256} 10:07:59.091499 --- ParallelTerminationStrategy: PID 5344 died... 10:07:59.110654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5344): Terminated: ok {rc=0} 10:07:59.154989 --- ParallelTerminationStrategy: PID 5347 died... 10:07:59.173950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5347): Terminated: ok {rc=0} 10:07:59.218672 --- ParallelTerminationStrategy: PID 5350 died... 10:07:59.237772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5350): Terminated: ok {rc=0} 10:07:59.324557 bus /gobi_4: Setting Powered False 10:08:00.426824 bus /gobi_4: Setting Powered False 10:08:01.551631 bus /gobi_1: Setting Powered False 10:08:02.657552 bus /gobi_1: Setting Powered False 10:08:03.774758 bus /gobi_0: Setting Powered False 10:08:04.874607 bus /gobi_0: Setting Powered False 10:08:05.992243 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 10:08:07.095884 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:07.107177 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:08:07.144921 tst ping.py: using LAC 40188 10:08:07.264223 tst ping.py: using RAC 153 10:08:07.381451 tst ping.py: using CellId 40188 10:08:07.504905 tst ping.py: using BVCI 40189 10:08:07.612212 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:07.622918 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:07.633634 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:07.644122 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:07.654925 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:07.665767 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:07.676604 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:07.687503 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:08:07.806553 tst ping.py:19: start network... 10:08:08.020001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:08.509466 run create_hlr_db(pid=5352): Launched 10:08:08.639621 bus /gobi_6: Setting Powered False 10:08:09.699034 run create_hlr_db(pid=5352): Terminated: ok {rc=0} 10:08:10.144150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5354): Launched 10:08:10.461607 run osmo-hlr_10.42.42.2(pid=5355): Launched 10:08:10.584069 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:11.130095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5357): Launched 10:08:11.445954 run osmo-stp_10.42.42.5(pid=5358): Launched 10:08:11.567425 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:08:12.111220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5360): Launched 10:08:12.234425 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:08:12.501693 run patchelf(pid=5361): Launched 10:08:12.678452 run osmo-stp_10.42.42.5(pid=5358): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5358)] 10:08:12.812509 run osmo-stp_10.42.42.5(pid=5358): stdout: | (launched: 2022-12-14_10:08:11.388431) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:12.948821 run osmo-stp_10.42.42.5(pid=5358): stderr: | 20221214100811576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100811576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100811577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100811577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100811578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100811578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100811578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:13.085660 run osmo-stp_10.42.42.5(pid=5358): stdout: | (launched: 2022-12-14_10:08:11.388431) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:13.215790 run osmo-stp_10.42.42.5(pid=5358): stderr: | 20221214100811576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100811576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100811577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100811577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100811578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100811578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100811578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:13.370115 run patchelf(pid=5361): Terminating (SIGINT) 10:08:13.548280 run patchelf(pid=5361): Terminated: ok {rc=0} 10:08:13.676810 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5358): Process ended prematurely: osmo-stp_10.42.42.5(pid=5358) [trial-2403↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5358)] [trial-2403↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 10:08:13.686854 tst ping.py:22: Test FAILED (6.6 sec) 10:08:13.715234 run osmo-hlr_10.42.42.2(pid=5355): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5355)] 10:08:13.765862 run osmo-hlr_10.42.42.2(pid=5355): stdout: | (launched: 2022-12-14_10:08:10.403698) 10:08:13.818105 run osmo-hlr_10.42.42.2(pid=5355): stderr: | 20221214100810600 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100810600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100810601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100810601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100810601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100810601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100810613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100810621 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100810622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100810622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:13.870870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5354): Terminating (SIGTERM) 10:08:13.913170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5357): Terminating (SIGTERM) 10:08:13.955655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5360): Terminating (SIGTERM) 10:08:13.998130 --- ParallelTerminationStrategy: PID 5354 died... 10:08:14.018420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5354): Terminated: ok {rc=0} 10:08:14.065456 --- ParallelTerminationStrategy: PID 5357 died... 10:08:14.085268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5357): Terminated: ok {rc=0} 10:08:14.131600 --- ParallelTerminationStrategy: PID 5360 died... 10:08:14.151214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5360): Terminated: ok {rc=0} 10:08:14.239590 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:08:15.326615 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:15.338592 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:08:15.378184 tst ping_idle_ping.py: using LAC 40189 10:08:15.504571 tst ping_idle_ping.py: using RAC 154 10:08:15.629193 tst ping_idle_ping.py: using CellId 40189 10:08:15.754954 tst ping_idle_ping.py: using BVCI 40190 10:08:15.874215 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:15.886428 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:15.901855 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:15.918104 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:15.931132 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:15.942977 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:15.955588 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:08:15.968472 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:08:16.090137 tst ping_idle_ping.py:24: start network... 10:08:16.296761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:16.778853 run create_hlr_db(pid=5362): Launched 10:08:16.937532 bus /gobi_6: Setting Powered False 10:08:17.997423 run create_hlr_db(pid=5362): Terminated: ok {rc=0} 10:08:18.435935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5364): Launched 10:08:18.755229 run osmo-hlr_10.42.42.2(pid=5365): Launched 10:08:18.877430 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:19.424776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5367): Launched 10:08:19.742441 run osmo-stp_10.42.42.5(pid=5368): Launched 10:08:19.864637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:08:20.411386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5370): Launched 10:08:20.535546 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:08:20.804433 run patchelf(pid=5371): Launched 10:08:20.981900 run osmo-stp_10.42.42.5(pid=5368): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5368)] 10:08:21.117879 run osmo-stp_10.42.42.5(pid=5368): stdout: | (launched: 2022-12-14_10:08:19.684309) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:21.254908 run osmo-stp_10.42.42.5(pid=5368): stderr: | 20221214100819875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100819875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100819875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100819875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100819876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100819876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100819876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:21.392590 run osmo-stp_10.42.42.5(pid=5368): stdout: | (launched: 2022-12-14_10:08:19.684309) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:21.523209 run osmo-stp_10.42.42.5(pid=5368): stderr: | 20221214100819875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100819875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100819875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100819875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100819876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100819876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100819876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:21.677434 run patchelf(pid=5371): Terminating (SIGINT) 10:08:21.855546 run patchelf(pid=5371): Terminated: ok {rc=0} 10:08:21.983987 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5368): Process ended prematurely: osmo-stp_10.42.42.5(pid=5368) [trial-2403↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5368)] [trial-2403↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 10:08:21.993872 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:08:22.022435 run osmo-hlr_10.42.42.2(pid=5365): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5365)] 10:08:22.073676 run osmo-hlr_10.42.42.2(pid=5365): stdout: | (launched: 2022-12-14_10:08:18.696533) 10:08:22.126129 run osmo-hlr_10.42.42.2(pid=5365): stderr: | 20221214100818892 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100818892 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100818892 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100818892 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100818892 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100818892 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100818906 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100818914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100818914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100818914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:22.178991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5364): Terminating (SIGTERM) 10:08:22.221438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5367): Terminating (SIGTERM) 10:08:22.263547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5370): Terminating (SIGTERM) 10:08:22.306013 --- ParallelTerminationStrategy: PID 5364 died... 10:08:22.326288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5364): Terminated: ok {rc=0} 10:08:22.372732 --- ParallelTerminationStrategy: PID 5367 died... 10:08:22.392413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5367): Terminated: ok {rc=0} 10:08:22.438615 --- ParallelTerminationStrategy: PID 5370 died... 10:08:22.458232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5370): Terminated: ok {rc=0} 10:08:22.545717 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:08:23.842799 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:23.849768 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:08:23.871317 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:08:23.911225 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:08:24.001248 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:08:24.022910 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:08:24.061740 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:08:24.654755 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:08:24.706579 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:24.717756 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:08:24.775517 tst cs_paging_gprs_active.py: using LAC 40190 10:08:24.901665 tst cs_paging_gprs_active.py: using RAC 155 10:08:25.028092 tst cs_paging_gprs_active.py: using CellId 40190 10:08:25.157239 tst cs_paging_gprs_active.py: using BVCI 40191 10:08:25.269511 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:25.280392 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:25.291113 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:25.301955 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:25.313259 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:25.324304 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:25.335477 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:25.346427 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:25.357724 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:08:25.478664 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:08:25.597609 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:08:25.801455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:08:26.107694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5376): Launched 10:08:26.373858 run iperf3-srv_10.42.42.10(pid=5377): Launched 10:08:26.488867 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:08:26.692469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:08:26.997725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5378): Launched 10:08:27.263589 run iperf3-srv_10.42.42.10(pid=5379): Launched 10:08:27.378921 tst cs_paging_gprs_active.py:38: start network... 10:08:27.582196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:28.051448 run create_hlr_db(pid=5380): Launched 10:08:28.168098 bus /gobi_6: Setting Powered False 10:08:29.228055 run create_hlr_db(pid=5380): Terminated: ok {rc=0} 10:08:29.671766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5382): Launched 10:08:29.994268 run osmo-hlr_10.42.42.2(pid=5383): Launched 10:08:30.118477 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:30.679520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5385): Launched 10:08:31.027355 run osmo-stp_10.42.42.5(pid=5386): Launched 10:08:31.272837 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:08:31.922331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5388): Launched 10:08:32.055223 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:08:32.331976 run patchelf(pid=5389): Launched 10:08:32.512052 run osmo-stp_10.42.42.5(pid=5386): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5386)] 10:08:32.650001 run osmo-stp_10.42.42.5(pid=5386): stdout: | (launched: 2022-12-14_10:08:30.968208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:32.789493 run osmo-stp_10.42.42.5(pid=5386): stderr: | 20221214100831266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100831266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100831266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100831267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100831267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100831267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100831267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:32.928367 run osmo-stp_10.42.42.5(pid=5386): stdout: | (launched: 2022-12-14_10:08:30.968208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:33.061107 run osmo-stp_10.42.42.5(pid=5386): stderr: | 20221214100831266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100831266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100831266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100831267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100831267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100831267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100831267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:33.219005 run patchelf(pid=5389): Terminating (SIGINT) 10:08:33.401529 run patchelf(pid=5389): Terminated: ok {rc=0} 10:08:33.533874 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5386): Process ended prematurely: osmo-stp_10.42.42.5(pid=5386) [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5386)] [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:08:33.544109 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 10:08:33.572807 run osmo-hlr_10.42.42.2(pid=5383): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5383)] 10:08:33.623001 run osmo-hlr_10.42.42.2(pid=5383): stdout: | (launched: 2022-12-14_10:08:29.935680) 10:08:33.674964 run osmo-hlr_10.42.42.2(pid=5383): stderr: | 20221214100830132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100830132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100830132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100830132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100830132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100830132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100830144 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100830152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100830153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100830153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:33.727479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5376): Terminating (SIGTERM) 10:08:33.769737 run iperf3-srv_10.42.42.10(pid=5377): Terminating (SIGTERM) 10:08:33.812008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5378): Terminating (SIGTERM) 10:08:33.853832 run iperf3-srv_10.42.42.10(pid=5379): Terminating (SIGTERM) 10:08:33.895894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5382): Terminating (SIGTERM) 10:08:33.938408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5385): Terminating (SIGTERM) 10:08:33.980119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5388): Terminating (SIGTERM) 10:08:34.022619 --- ParallelTerminationStrategy: PID 5376 died... 10:08:34.042763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5376): Terminated: ok {rc=0} 10:08:34.089454 --- ParallelTerminationStrategy: PID 5377 died... 10:08:34.108799 run iperf3-srv_10.42.42.10(pid=5377): Terminated {rc=256} 10:08:34.154762 --- ParallelTerminationStrategy: PID 5378 died... 10:08:34.174147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5378): Terminated: ok {rc=0} 10:08:34.219900 --- ParallelTerminationStrategy: PID 5379 died... 10:08:34.239291 run iperf3-srv_10.42.42.10(pid=5379): Terminated {rc=256} 10:08:34.285093 --- ParallelTerminationStrategy: PID 5382 died... 10:08:34.304464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5382): Terminated: ok {rc=0} 10:08:34.350426 --- ParallelTerminationStrategy: PID 5385 died... 10:08:34.369900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5385): Terminated: ok {rc=0} 10:08:34.415511 --- ParallelTerminationStrategy: PID 5388 died... 10:08:34.434946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5388): Terminated: ok {rc=0} 10:08:34.523204 bus /gobi_0: Setting Powered False 10:08:35.622394 bus /gobi_0: Setting Powered False 10:08:36.738138 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:08:37.883016 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:37.894543 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:08:37.954631 tst iperf3.py: using LAC 40191 10:08:38.074894 tst iperf3.py: using RAC 156 10:08:38.195099 tst iperf3.py: using CellId 40191 10:08:38.314405 tst iperf3.py: using BVCI 40192 10:08:38.426238 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:38.437237 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:38.447849 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:38.458457 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:38.469246 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:38.480005 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:38.491117 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:38.501924 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:38.512798 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:08:38.629660 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:08:38.831568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:08:39.135826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5390): Launched 10:08:39.401405 run iperf3-srv_10.42.42.10(pid=5391): Launched 10:08:39.515660 tst iperf3.py:8: start network... 10:08:39.718656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:40.186839 run create_hlr_db(pid=5392): Launched 10:08:40.302851 bus /gobi_6: Setting Powered False 10:08:41.362632 run create_hlr_db(pid=5392): Terminated: ok {rc=0} 10:08:41.784711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5394): Launched 10:08:42.088122 run osmo-hlr_10.42.42.2(pid=5395): Launched 10:08:42.203819 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:42.737163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5397): Launched 10:08:43.040331 run osmo-stp_10.42.42.5(pid=5398): Launched 10:08:43.156386 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:08:43.677895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5400): Launched 10:08:43.795096 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:08:44.050858 run patchelf(pid=5401): Launched 10:08:44.220393 run osmo-stp_10.42.42.5(pid=5398): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5398)] 10:08:44.348928 run osmo-stp_10.42.42.5(pid=5398): stdout: | (launched: 2022-12-14_10:08:42.984722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:44.479086 run osmo-stp_10.42.42.5(pid=5398): stderr: | 20221214100843155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100843155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100843156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100843156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100843157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100843157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100843157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:44.609580 run osmo-stp_10.42.42.5(pid=5398): stdout: | (launched: 2022-12-14_10:08:42.984722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:44.733730 run osmo-stp_10.42.42.5(pid=5398): stderr: | 20221214100843155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100843155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100843156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100843156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100843157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100843157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100843157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:44.880518 run patchelf(pid=5401): Terminating (SIGINT) 10:08:45.050764 run patchelf(pid=5401): Terminated: ok {rc=0} 10:08:45.174215 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5398): Process ended prematurely: osmo-stp_10.42.42.5(pid=5398) [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5398)] [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 10:08:45.183821 tst iperf3.py:8: Test FAILED (7.3 sec) 10:08:45.211039 run osmo-hlr_10.42.42.2(pid=5395): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5395)] 10:08:45.258982 run osmo-hlr_10.42.42.2(pid=5395): stdout: | (launched: 2022-12-14_10:08:42.032586) 10:08:45.308855 run osmo-hlr_10.42.42.2(pid=5395): stderr: | 20221214100842209 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100842209 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100842209 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100842209 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100842209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100842209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100842222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100842230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100842231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100842231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:45.359110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5390): Terminating (SIGTERM) 10:08:45.399350 run iperf3-srv_10.42.42.10(pid=5391): Terminating (SIGTERM) 10:08:45.439580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5394): Terminating (SIGTERM) 10:08:45.479966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5397): Terminating (SIGTERM) 10:08:45.519986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5400): Terminating (SIGTERM) 10:08:45.560617 --- ParallelTerminationStrategy: PID 5390 died... 10:08:45.580256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5390): Terminated: ok {rc=0} 10:08:45.625247 --- ParallelTerminationStrategy: PID 5391 died... 10:08:45.644109 run iperf3-srv_10.42.42.10(pid=5391): Terminated {rc=256} 10:08:45.688456 --- ParallelTerminationStrategy: PID 5394 died... 10:08:45.707222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5394): Terminated: ok {rc=0} 10:08:45.751183 --- ParallelTerminationStrategy: PID 5397 died... 10:08:45.770147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5397): Terminated: ok {rc=0} 10:08:45.814176 --- ParallelTerminationStrategy: PID 5400 died... 10:08:45.837555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5400): Terminated: ok {rc=0} 10:08:45.954101 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:08:47.135210 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:47.147255 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:08:47.203407 tst iperf3m4.py: using LAC 40192 10:08:47.330222 tst iperf3m4.py: using RAC 157 10:08:47.451085 tst iperf3m4.py: using CellId 40192 10:08:47.568647 tst iperf3m4.py: using BVCI 40193 10:08:47.678256 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:47.689272 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:47.699970 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:47.710804 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:47.721846 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:47.732561 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:47.743771 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:47.754745 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:08:47.766016 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:08:47.887072 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:08:48.009397 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:08:48.127418 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:08:48.247437 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:08:48.466157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:08:48.791932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5402): Launched 10:08:49.073472 run iperf3-srv_10.42.42.10(pid=5403): Launched 10:08:49.195906 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:08:49.413137 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:08:49.738563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5404): Launched 10:08:50.021724 run iperf3-srv_10.42.42.10(pid=5405): Launched 10:08:50.144536 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:08:50.362718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:08:50.688502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5406): Launched 10:08:50.970558 run iperf3-srv_10.42.42.10(pid=5407): Launched 10:08:51.093796 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:08:51.311289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:08:51.636406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5408): Launched 10:08:51.918504 run iperf3-srv_10.42.42.10(pid=5409): Launched 10:08:52.041664 tst iperf3m4.py:8: start network... 10:08:52.259179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:52.760237 run create_hlr_db(pid=5410): Launched 10:08:52.892082 bus /gobi_6: Setting Powered False 10:08:53.955108 run create_hlr_db(pid=5410): Terminated: ok {rc=0} 10:08:54.390235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5412): Launched 10:08:54.694060 run osmo-hlr_10.42.42.2(pid=5413): Launched 10:08:54.809738 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:55.347995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5415): Launched 10:08:55.674157 run osmo-stp_10.42.42.5(pid=5416): Launched 10:08:55.797813 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:08:56.354667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5418): Launched 10:08:56.481693 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:08:56.755563 run patchelf(pid=5419): Launched 10:08:56.938157 run osmo-stp_10.42.42.5(pid=5416): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5416)] 10:08:57.075787 run osmo-stp_10.42.42.5(pid=5416): stdout: | (launched: 2022-12-14_10:08:55.614507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:57.215533 run osmo-stp_10.42.42.5(pid=5416): stderr: | 20221214100855803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100855803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100855804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100855804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100855804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100855805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100855805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:57.355032 run osmo-stp_10.42.42.5(pid=5416): stdout: | (launched: 2022-12-14_10:08:55.614507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:57.487966 run osmo-stp_10.42.42.5(pid=5416): stderr: | 20221214100855803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100855803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100855804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100855804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100855804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100855805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100855805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:57.645395 run patchelf(pid=5419): Terminating (SIGINT) 10:08:57.828138 run patchelf(pid=5419): Terminated: ok {rc=0} 10:08:57.959882 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5416): Process ended prematurely: osmo-stp_10.42.42.5(pid=5416) [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5416)] [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:08:57.970106 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:08:57.998912 run osmo-hlr_10.42.42.2(pid=5413): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5413)] 10:08:58.049146 run osmo-hlr_10.42.42.2(pid=5413): stdout: | (launched: 2022-12-14_10:08:54.638486) 10:08:58.101531 run osmo-hlr_10.42.42.2(pid=5413): stderr: | 20221214100854810 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100854810 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100854810 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100854810 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100854810 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100854811 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100854823 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100854831 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100854831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100854831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:58.154129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5402): Terminating (SIGTERM) 10:08:58.196009 run iperf3-srv_10.42.42.10(pid=5403): Terminating (SIGTERM) 10:08:58.237978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5404): Terminating (SIGTERM) 10:08:58.279843 run iperf3-srv_10.42.42.10(pid=5405): Terminating (SIGTERM) 10:08:58.321686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5406): Terminating (SIGTERM) 10:08:58.364192 run iperf3-srv_10.42.42.10(pid=5407): Terminating (SIGTERM) 10:08:58.405972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5408): Terminating (SIGTERM) 10:08:58.447804 run iperf3-srv_10.42.42.10(pid=5409): Terminating (SIGTERM) 10:08:58.489938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5412): Terminating (SIGTERM) 10:08:58.531671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5415): Terminating (SIGTERM) 10:08:58.573435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5418): Terminating (SIGTERM) 10:08:58.615895 --- ParallelTerminationStrategy: PID 5402 died... 10:08:58.635875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5402): Terminated: ok {rc=0} 10:08:58.682627 --- ParallelTerminationStrategy: PID 5403 died... 10:08:58.702110 run iperf3-srv_10.42.42.10(pid=5403): Terminated {rc=256} 10:08:58.748189 --- ParallelTerminationStrategy: PID 5404 died... 10:08:58.767787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5404): Terminated: ok {rc=0} 10:08:58.813870 --- ParallelTerminationStrategy: PID 5405 died... 10:08:58.833403 run iperf3-srv_10.42.42.10(pid=5405): Terminated {rc=256} 10:08:58.879207 --- ParallelTerminationStrategy: PID 5406 died... 10:08:58.898748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5406): Terminated: ok {rc=0} 10:08:58.944813 --- ParallelTerminationStrategy: PID 5407 died... 10:08:58.964711 run iperf3-srv_10.42.42.10(pid=5407): Terminated {rc=256} 10:08:59.010836 --- ParallelTerminationStrategy: PID 5408 died... 10:08:59.030341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5408): Terminated: ok {rc=0} 10:08:59.076413 --- ParallelTerminationStrategy: PID 5409 died... 10:08:59.096423 run iperf3-srv_10.42.42.10(pid=5409): Terminated {rc=256} 10:08:59.142484 --- ParallelTerminationStrategy: PID 5412 died... 10:08:59.162159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5412): Terminated: ok {rc=0} 10:08:59.208251 --- ParallelTerminationStrategy: PID 5415 died... 10:08:59.227941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5415): Terminated: ok {rc=0} 10:08:59.273857 --- ParallelTerminationStrategy: PID 5418 died... 10:08:59.293466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5418): Terminated: ok {rc=0} 10:08:59.381468 bus /gobi_4: Setting Powered False 10:09:00.480147 bus /gobi_4: Setting Powered False 10:09:01.594732 bus /gobi_1: Setting Powered False 10:09:02.725254 bus /gobi_1: Setting Powered False 10:09:03.877395 bus /gobi_0: Setting Powered False 10:09:04.983016 bus /gobi_0: Setting Powered False 10:09:06.106771 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:09:07.215885 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:07.229346 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:09:07.291396 tst ping.py: using LAC 40193 10:09:07.416407 tst ping.py: using RAC 158 10:09:07.542395 tst ping.py: using CellId 40193 10:09:07.670064 tst ping.py: using BVCI 40194 10:09:07.789106 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:07.801010 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:07.812674 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:07.825062 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:07.837778 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:07.849588 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:07.861705 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:07.873664 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:09:07.998453 tst ping.py:19: start network... 10:09:08.217792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:08.723091 run create_hlr_db(pid=5692): Launched 10:09:08.889961 bus /gobi_6: Setting Powered False 10:09:09.956449 run create_hlr_db(pid=5692): Terminated: ok {rc=0} 10:09:10.391153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5694): Launched 10:09:10.706680 run osmo-hlr_10.42.42.2(pid=5695): Launched 10:09:10.940321 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:11.630558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5697): Launched 10:09:11.949104 run osmo-stp_10.42.42.5(pid=5698): Launched 10:09:12.187114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:09:12.854500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5700): Launched 10:09:12.985117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:09:13.243763 run patchelf(pid=5701): Launched 10:09:13.430171 run osmo-stp_10.42.42.5(pid=5698): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5698)] 10:09:13.561815 run osmo-stp_10.42.42.5(pid=5698): stdout: | (launched: 2022-12-14_10:09:11.893514) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:13.695122 run osmo-stp_10.42.42.5(pid=5698): stderr: | 20221214100912222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100912222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100912222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100912223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100912223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100912223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100912223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:13.828803 run osmo-stp_10.42.42.5(pid=5698): stdout: | (launched: 2022-12-14_10:09:11.893514) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:13.955257 run osmo-stp_10.42.42.5(pid=5698): stderr: | 20221214100912222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100912222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100912222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100912223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100912223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100912223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100912223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:14.105240 run patchelf(pid=5701): Terminating (SIGINT) 10:09:14.278653 run patchelf(pid=5701): Terminated: ok {rc=0} 10:09:14.404565 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5698): Process ended prematurely: osmo-stp_10.42.42.5(pid=5698) [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5698)] [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 10:09:14.414940 tst ping.py:22: Test FAILED (7.2 sec) 10:09:14.443461 run osmo-hlr_10.42.42.2(pid=5695): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5695)] 10:09:14.496084 run osmo-hlr_10.42.42.2(pid=5695): stdout: | (launched: 2022-12-14_10:09:10.651030) 10:09:14.548609 run osmo-hlr_10.42.42.2(pid=5695): stderr: | 20221214100910982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100910982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100910982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100910982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100910982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100910982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100911053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100911066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100911066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100911066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:14.601977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5694): Terminating (SIGTERM) 10:09:14.644482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5697): Terminating (SIGTERM) 10:09:14.689878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5700): Terminating (SIGTERM) 10:09:14.735321 --- ParallelTerminationStrategy: PID 5694 died... 10:09:14.756940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5694): Terminated: ok {rc=0} 10:09:14.805669 --- ParallelTerminationStrategy: PID 5697 died... 10:09:14.826566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5697): Terminated: ok {rc=0} 10:09:14.873764 --- ParallelTerminationStrategy: PID 5700 died... 10:09:14.894849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5700): Terminated: ok {rc=0} 10:09:14.984668 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:09:16.090126 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:16.112022 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:09:16.185715 tst ping_idle_ping.py: using LAC 40194 10:09:16.333060 tst ping_idle_ping.py: using RAC 159 10:09:16.476771 tst ping_idle_ping.py: using CellId 40194 10:09:16.646055 tst ping_idle_ping.py: using BVCI 40195 10:09:16.786179 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:16.800498 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:16.814286 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:16.829337 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:16.843138 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:16.857617 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:16.870880 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:09:16.886181 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:09:17.037157 tst ping_idle_ping.py:24: start network... 10:09:17.287418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:17.772431 run create_hlr_db(pid=5702): Launched 10:09:17.927180 bus /gobi_6: Setting Powered False 10:09:18.994024 run create_hlr_db(pid=5702): Terminated: ok {rc=0} 10:09:19.432282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5704): Launched 10:09:19.749177 run osmo-hlr_10.42.42.2(pid=5705): Launched 10:09:19.985448 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:20.651640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5707): Launched 10:09:20.995628 run osmo-stp_10.42.42.5(pid=5708): Launched 10:09:21.240282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:09:21.891202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5710): Launched 10:09:22.029420 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:09:22.306640 run patchelf(pid=5711): Launched 10:09:22.503634 run osmo-stp_10.42.42.5(pid=5708): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5708)] 10:09:22.646137 run osmo-stp_10.42.42.5(pid=5708): stdout: | (launched: 2022-12-14_10:09:20.936189) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:22.790557 run osmo-stp_10.42.42.5(pid=5708): stderr: | 20221214100921227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100921227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100921227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100921228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100921228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100921228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100921228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:22.934228 run osmo-stp_10.42.42.5(pid=5708): stdout: | (launched: 2022-12-14_10:09:20.936189) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:23.073462 run osmo-stp_10.42.42.5(pid=5708): stderr: | 20221214100921227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100921227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100921227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100921228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100921228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100921228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100921228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:23.235632 run patchelf(pid=5711): Terminating (SIGINT) 10:09:23.421437 run patchelf(pid=5711): Terminated: ok {rc=0} 10:09:23.557036 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5708): Process ended prematurely: osmo-stp_10.42.42.5(pid=5708) [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5708)] [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:09:23.568594 tst ping_idle_ping.py:27: Test FAILED (7.5 sec) 10:09:23.599824 run osmo-hlr_10.42.42.2(pid=5705): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5705)] 10:09:23.652581 run osmo-hlr_10.42.42.2(pid=5705): stdout: | (launched: 2022-12-14_10:09:19.693134) 10:09:23.707780 run osmo-hlr_10.42.42.2(pid=5705): stderr: | 20221214100920025 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100920026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100920026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100920026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100920026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100920026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100920047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100920055 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100920055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100920056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:23.765556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5704): Terminating (SIGTERM) 10:09:23.810886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5707): Terminating (SIGTERM) 10:09:23.856845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5710): Terminating (SIGTERM) 10:09:23.904091 --- ParallelTerminationStrategy: PID 5704 died... 10:09:23.926674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5704): Terminated: ok {rc=0} 10:09:23.978259 --- ParallelTerminationStrategy: PID 5707 died... 10:09:23.999378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5707): Terminated: ok {rc=0} 10:09:24.048842 --- ParallelTerminationStrategy: PID 5710 died... 10:09:24.069949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5710): Terminated: ok {rc=0} 10:09:24.165114 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:09:25.454110 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:09:25.460112 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:09:25.480244 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:09:25.519887 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:09:25.604634 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:09:25.625111 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:09:25.663477 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:09:26.256802 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:09:26.306953 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:26.317924 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:09:26.374322 tst cs_paging_gprs_active.py: using LAC 40195 10:09:26.492843 tst cs_paging_gprs_active.py: using RAC 160 10:09:26.610926 tst cs_paging_gprs_active.py: using CellId 40195 10:09:26.730839 tst cs_paging_gprs_active.py: using BVCI 40196 10:09:26.843275 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:26.854073 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:26.864538 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:26.875074 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:26.886340 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:26.897895 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:26.909524 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:26.920797 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:26.932387 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:09:27.053304 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:09:27.174495 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:09:27.394190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:09:27.720525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5716): Launched 10:09:28.004837 run iperf3-srv_10.42.42.10(pid=5717): Launched 10:09:28.127966 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:09:28.346697 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:09:28.672326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5718): Launched 10:09:28.955297 run iperf3-srv_10.42.42.10(pid=5719): Launched 10:09:29.076933 tst cs_paging_gprs_active.py:38: start network... 10:09:29.295016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:29.796790 run create_hlr_db(pid=5720): Launched 10:09:29.931174 bus /gobi_6: Setting Powered False 10:09:31.007972 run create_hlr_db(pid=5720): Terminated: ok {rc=0} 10:09:31.458924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5722): Launched 10:09:31.790556 run osmo-hlr_10.42.42.2(pid=5723): Launched 10:09:32.030518 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:32.626748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5725): Launched 10:09:32.954138 run osmo-stp_10.42.42.5(pid=5726): Launched 10:09:33.078387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:09:33.639340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5728): Launched 10:09:33.765666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:09:34.040290 run patchelf(pid=5729): Launched 10:09:34.222239 run osmo-stp_10.42.42.5(pid=5726): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5726)] 10:09:34.360379 run osmo-stp_10.42.42.5(pid=5726): stdout: | (launched: 2022-12-14_10:09:32.894159) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:34.499996 run osmo-stp_10.42.42.5(pid=5726): stderr: | 20221214100933084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100933084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100933085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100933085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100933085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100933086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100933086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:34.639655 run osmo-stp_10.42.42.5(pid=5726): stdout: | (launched: 2022-12-14_10:09:32.894159) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:34.772426 run osmo-stp_10.42.42.5(pid=5726): stderr: | 20221214100933084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100933084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100933085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100933085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100933085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100933086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100933086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:34.930073 run patchelf(pid=5729): Terminating (SIGINT) 10:09:35.113399 run patchelf(pid=5729): Terminated: ok {rc=0} 10:09:35.244696 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5726): Process ended prematurely: osmo-stp_10.42.42.5(pid=5726) [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5726)] [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:09:35.255108 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 10:09:35.283619 run osmo-hlr_10.42.42.2(pid=5723): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5723)] 10:09:35.333902 run osmo-hlr_10.42.42.2(pid=5723): stdout: | (launched: 2022-12-14_10:09:31.731882) 10:09:35.385906 run osmo-hlr_10.42.42.2(pid=5723): stderr: | 20221214100932055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100932055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100932056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100932056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100932056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100932056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100932071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100932083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100932083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100932083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:35.438552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5716): Terminating (SIGTERM) 10:09:35.480515 run iperf3-srv_10.42.42.10(pid=5717): Terminating (SIGTERM) 10:09:35.523202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5718): Terminating (SIGTERM) 10:09:35.565275 run iperf3-srv_10.42.42.10(pid=5719): Terminating (SIGTERM) 10:09:35.607477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5722): Terminating (SIGTERM) 10:09:35.649495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5725): Terminating (SIGTERM) 10:09:35.691830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5728): Terminating (SIGTERM) 10:09:35.734250 --- ParallelTerminationStrategy: PID 5716 died... 10:09:35.754481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5716): Terminated: ok {rc=0} 10:09:35.800858 --- ParallelTerminationStrategy: PID 5717 died... 10:09:35.820834 run iperf3-srv_10.42.42.10(pid=5717): Terminated {rc=256} 10:09:35.866829 --- ParallelTerminationStrategy: PID 5718 died... 10:09:35.886503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5718): Terminated: ok {rc=0} 10:09:35.932691 --- ParallelTerminationStrategy: PID 5719 died... 10:09:35.952584 run iperf3-srv_10.42.42.10(pid=5719): Terminated {rc=256} 10:09:35.998954 --- ParallelTerminationStrategy: PID 5722 died... 10:09:36.018671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5722): Terminated: ok {rc=0} 10:09:36.065073 --- ParallelTerminationStrategy: PID 5725 died... 10:09:36.084726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5725): Terminated: ok {rc=0} 10:09:36.131165 --- ParallelTerminationStrategy: PID 5728 died... 10:09:36.151006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5728): Terminated: ok {rc=0} 10:09:36.239077 bus /gobi_0: Setting Powered False 10:09:37.338745 bus /gobi_0: Setting Powered False 10:09:38.456410 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:09:39.603334 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:39.615175 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:09:39.675345 tst iperf3.py: using LAC 40196 10:09:39.795686 tst iperf3.py: using RAC 161 10:09:39.914564 tst iperf3.py: using CellId 40196 10:09:40.035475 tst iperf3.py: using BVCI 40197 10:09:40.146051 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:40.157108 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:40.167780 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:40.178363 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:40.189207 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:40.199986 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:40.211036 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:40.221853 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:40.232770 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:09:40.349162 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:09:40.553130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:09:40.859165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5730): Launched 10:09:41.125689 run iperf3-srv_10.42.42.10(pid=5731): Launched 10:09:41.240627 tst iperf3.py:8: start network... 10:09:41.444224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:41.915803 run create_hlr_db(pid=5732): Launched 10:09:42.031643 bus /gobi_6: Setting Powered False 10:09:43.091391 run create_hlr_db(pid=5732): Terminated: ok {rc=0} 10:09:43.516033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5734): Launched 10:09:43.820629 run osmo-hlr_10.42.42.2(pid=5735): Launched 10:09:43.937422 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:44.465310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5737): Launched 10:09:44.769920 run osmo-stp_10.42.42.5(pid=5738): Launched 10:09:44.885742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:09:45.408357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5740): Launched 10:09:45.525791 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:09:45.782641 run patchelf(pid=5741): Launched 10:09:45.955437 run osmo-stp_10.42.42.5(pid=5738): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5738)] 10:09:46.088254 run osmo-stp_10.42.42.5(pid=5738): stdout: | (launched: 2022-12-14_10:09:44.713696) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:46.222633 run osmo-stp_10.42.42.5(pid=5738): stderr: | 20221214100944884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100944885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100944885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100944885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100944886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100944886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100944886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:46.357663 run osmo-stp_10.42.42.5(pid=5738): stdout: | (launched: 2022-12-14_10:09:44.713696) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:46.486336 run osmo-stp_10.42.42.5(pid=5738): stderr: | 20221214100944884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100944885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100944885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100944885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100944886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100944886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100944886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:46.638964 run patchelf(pid=5741): Terminating (SIGINT) 10:09:46.815032 run patchelf(pid=5741): Terminated: ok {rc=0} 10:09:46.943263 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5738): Process ended prematurely: osmo-stp_10.42.42.5(pid=5738) [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5738)] [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 10:09:46.954083 tst iperf3.py:8: Test FAILED (7.4 sec) 10:09:46.982450 run osmo-hlr_10.42.42.2(pid=5735): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5735)] 10:09:47.033824 run osmo-hlr_10.42.42.2(pid=5735): stdout: | (launched: 2022-12-14_10:09:43.764856) 10:09:47.086645 run osmo-hlr_10.42.42.2(pid=5735): stderr: | 20221214100943939 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100943939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100943940 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100943940 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100943940 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100943940 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100943952 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100943961 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100943961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100943961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:47.139422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5730): Terminating (SIGTERM) 10:09:47.180559 run iperf3-srv_10.42.42.10(pid=5731): Terminating (SIGTERM) 10:09:47.222321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5734): Terminating (SIGTERM) 10:09:47.264732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5737): Terminating (SIGTERM) 10:09:47.305104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5740): Terminating (SIGTERM) 10:09:47.345457 --- ParallelTerminationStrategy: PID 5730 died... 10:09:47.365170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5730): Terminated: ok {rc=0} 10:09:47.409634 --- ParallelTerminationStrategy: PID 5731 died... 10:09:47.428617 run iperf3-srv_10.42.42.10(pid=5731): Terminated {rc=256} 10:09:47.472803 --- ParallelTerminationStrategy: PID 5734 died... 10:09:47.491863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5734): Terminated: ok {rc=0} 10:09:47.535958 --- ParallelTerminationStrategy: PID 5737 died... 10:09:47.555151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5737): Terminated: ok {rc=0} 10:09:47.599453 --- ParallelTerminationStrategy: PID 5740 died... 10:09:47.618577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5740): Terminated: ok {rc=0} 10:09:47.703593 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:09:48.848424 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:48.860002 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:09:48.918218 tst iperf3m4.py: using LAC 40197 10:09:49.051528 tst iperf3m4.py: using RAC 162 10:09:49.176447 tst iperf3m4.py: using CellId 40197 10:09:49.297235 tst iperf3m4.py: using BVCI 40198 10:09:49.407123 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:49.418362 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:49.429079 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:49.439829 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:49.450771 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:49.461694 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:49.472647 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:49.483500 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:09:49.494534 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:09:49.610637 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:09:49.733647 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:09:49.854855 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:09:49.974487 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:09:50.179114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:09:50.485831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5742): Launched 10:09:50.752662 run iperf3-srv_10.42.42.10(pid=5743): Launched 10:09:50.867860 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:09:51.070600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:09:51.376082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5744): Launched 10:09:51.643046 run iperf3-srv_10.42.42.10(pid=5745): Launched 10:09:51.756827 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:09:51.959025 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:09:52.263354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5746): Launched 10:09:52.528236 run iperf3-srv_10.42.42.10(pid=5747): Launched 10:09:52.642489 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:09:52.844216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:09:53.148393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5748): Launched 10:09:53.413289 run iperf3-srv_10.42.42.10(pid=5749): Launched 10:09:53.527305 tst iperf3m4.py:8: start network... 10:09:53.730333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:54.199785 run create_hlr_db(pid=5750): Launched 10:09:54.316052 bus /gobi_6: Setting Powered False 10:09:55.377211 run create_hlr_db(pid=5750): Terminated: ok {rc=0} 10:09:55.820739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5752): Launched 10:09:56.146463 run osmo-hlr_10.42.42.2(pid=5753): Launched 10:09:56.271865 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:56.831392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5755): Launched 10:09:57.156133 run osmo-stp_10.42.42.5(pid=5756): Launched 10:09:57.282255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:09:57.843005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5758): Launched 10:09:57.968837 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:09:58.245533 run patchelf(pid=5759): Launched 10:09:58.428447 run osmo-stp_10.42.42.5(pid=5756): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5756)] 10:09:58.566922 run osmo-stp_10.42.42.5(pid=5756): stdout: | (launched: 2022-12-14_10:09:57.096335) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:58.707421 run osmo-stp_10.42.42.5(pid=5756): stderr: | 20221214100957283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100957284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100957284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100957284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100957285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100957285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100957285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:58.847750 run osmo-stp_10.42.42.5(pid=5756): stdout: | (launched: 2022-12-14_10:09:57.096335) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:58.981601 run osmo-stp_10.42.42.5(pid=5756): stderr: | 20221214100957283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214100957284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214100957284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214100957284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214100957285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214100957285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214100957285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:59.140247 run patchelf(pid=5759): Terminating (SIGINT) 10:09:59.323518 run patchelf(pid=5759): Terminated: ok {rc=0} 10:09:59.455947 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5756): Process ended prematurely: osmo-stp_10.42.42.5(pid=5756) [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5756)] [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:09:59.466375 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:09:59.495640 run osmo-hlr_10.42.42.2(pid=5753): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5753)] 10:09:59.546636 run osmo-hlr_10.42.42.2(pid=5753): stdout: | (launched: 2022-12-14_10:09:56.086432) 10:09:59.599572 run osmo-hlr_10.42.42.2(pid=5753): stderr: | 20221214100956280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214100956280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214100956280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214100956280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214100956280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214100956280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214100956292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214100956301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214100956301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214100956301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:59.652635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5742): Terminating (SIGTERM) 10:09:59.695359 run iperf3-srv_10.42.42.10(pid=5743): Terminating (SIGTERM) 10:09:59.738173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5744): Terminating (SIGTERM) 10:09:59.780632 run iperf3-srv_10.42.42.10(pid=5745): Terminating (SIGTERM) 10:09:59.823244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5746): Terminating (SIGTERM) 10:09:59.865853 run iperf3-srv_10.42.42.10(pid=5747): Terminating (SIGTERM) 10:09:59.908250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5748): Terminating (SIGTERM) 10:09:59.951459 run iperf3-srv_10.42.42.10(pid=5749): Terminating (SIGTERM) 10:09:59.994157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5752): Terminating (SIGTERM) 10:10:00.036722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5755): Terminating (SIGTERM) 10:10:00.079156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5758): Terminating (SIGTERM) 10:10:00.122250 --- ParallelTerminationStrategy: PID 5742 died... 10:10:00.142982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5742): Terminated: ok {rc=0} 10:10:00.190458 --- ParallelTerminationStrategy: PID 5743 died... 10:10:00.210699 run iperf3-srv_10.42.42.10(pid=5743): Terminated {rc=256} 10:10:00.257313 --- ParallelTerminationStrategy: PID 5744 died... 10:10:00.277339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5744): Terminated: ok {rc=0} 10:10:00.323809 --- ParallelTerminationStrategy: PID 5745 died... 10:10:00.343638 run iperf3-srv_10.42.42.10(pid=5745): Terminated {rc=256} 10:10:00.390120 --- ParallelTerminationStrategy: PID 5746 died... 10:10:00.409942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5746): Terminated: ok {rc=0} 10:10:00.456387 --- ParallelTerminationStrategy: PID 5747 died... 10:10:00.476194 run iperf3-srv_10.42.42.10(pid=5747): Terminated {rc=256} 10:10:00.522479 --- ParallelTerminationStrategy: PID 5748 died... 10:10:00.542284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5748): Terminated: ok {rc=0} 10:10:00.589060 --- ParallelTerminationStrategy: PID 5749 died... 10:10:00.608912 run iperf3-srv_10.42.42.10(pid=5749): Terminated {rc=256} 10:10:00.654980 --- ParallelTerminationStrategy: PID 5752 died... 10:10:00.674830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5752): Terminated: ok {rc=0} 10:10:00.721456 --- ParallelTerminationStrategy: PID 5755 died... 10:10:00.741302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5755): Terminated: ok {rc=0} 10:10:00.787676 --- ParallelTerminationStrategy: PID 5758 died... 10:10:00.807603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5758): Terminated: ok {rc=0} 10:10:00.919822 bus /gobi_4: Setting Powered False 10:10:02.044144 bus /gobi_4: Setting Powered False 10:10:03.181131 bus /gobi_1: Setting Powered False 10:10:04.280558 bus /gobi_1: Setting Powered False 10:10:05.397596 bus /gobi_0: Setting Powered False 10:10:06.493219 bus /gobi_0: Setting Powered False 10:10:07.610772 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:10:08.714459 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:08.725955 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:10:08.783343 tst ping.py: using LAC 40198 10:10:08.901605 tst ping.py: using RAC 163 10:10:09.024157 tst ping.py: using CellId 40198 10:10:09.142389 tst ping.py: using BVCI 40199 10:10:09.253541 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:09.264373 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:09.275093 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:09.285738 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:09.296605 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:09.307471 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:09.318965 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:09.330086 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:10:09.445706 tst ping.py:19: start network... 10:10:09.647012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:10.110517 run create_hlr_db(pid=5770): Launched 10:10:10.225966 bus /gobi_6: Setting Powered False 10:10:11.285915 run create_hlr_db(pid=5770): Terminated: ok {rc=0} 10:10:11.726755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5772): Launched 10:10:12.048554 run osmo-hlr_10.42.42.2(pid=5773): Launched 10:10:12.172078 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:12.733763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5779): Launched 10:10:13.053468 run osmo-stp_10.42.42.5(pid=5823): Launched 10:10:13.299746 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:10:13.914870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5964): Launched 10:10:14.046846 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:10:14.313903 run patchelf(pid=6048): Launched 10:10:14.499617 run osmo-stp_10.42.42.5(pid=5823): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5823)] 10:10:14.635997 run osmo-stp_10.42.42.5(pid=5823): stdout: | (launched: 2022-12-14_10:10:12.996789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:14.771643 run osmo-stp_10.42.42.5(pid=5823): stderr: | 20221214101013276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101013276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101013285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101013286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101013286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101013286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101013286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:14.901604 run osmo-stp_10.42.42.5(pid=5823): stdout: | (launched: 2022-12-14_10:10:12.996789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:15.024741 run osmo-stp_10.42.42.5(pid=5823): stderr: | 20221214101013276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101013276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101013285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101013286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101013286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101013286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101013286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:15.170382 run patchelf(pid=6048): Terminating (SIGINT) 10:10:15.339719 run patchelf(pid=6048): Terminated: ok {rc=0} 10:10:15.462181 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5823): Process ended prematurely: osmo-stp_10.42.42.5(pid=5823) [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5823)] [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 10:10:15.471342 tst ping.py:22: Test FAILED (6.7 sec) 10:10:15.498616 run osmo-hlr_10.42.42.2(pid=5773): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5773)] 10:10:15.547809 run osmo-hlr_10.42.42.2(pid=5773): stdout: | (launched: 2022-12-14_10:10:11.989908) 10:10:15.598557 run osmo-hlr_10.42.42.2(pid=5773): stderr: | 20221214101012188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101012188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101012188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101012188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101012188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101012188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101012199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101012208 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101012208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101012208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:15.649628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5772): Terminating (SIGTERM) 10:10:15.690858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5779): Terminating (SIGTERM) 10:10:15.731677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5964): Terminating (SIGTERM) 10:10:15.773326 --- ParallelTerminationStrategy: PID 5772 died... 10:10:15.793098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5772): Terminated: ok {rc=0} 10:10:15.840528 --- ParallelTerminationStrategy: PID 5779 died... 10:10:15.860939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5779): Terminated: ok {rc=0} 10:10:15.907826 --- ParallelTerminationStrategy: PID 5964 died... 10:10:15.928557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5964): Terminated: ok {rc=0} 10:10:16.023208 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:10:17.109818 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:17.124173 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:10:17.188805 tst ping_idle_ping.py: using LAC 40199 10:10:17.311885 tst ping_idle_ping.py: using RAC 164 10:10:17.428682 tst ping_idle_ping.py: using CellId 40199 10:10:17.545154 tst ping_idle_ping.py: using BVCI 40200 10:10:17.653871 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:17.664755 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:17.675554 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:17.686378 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:17.697271 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:17.708110 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:17.719200 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:10:17.730226 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:10:17.850293 tst ping_idle_ping.py:24: start network... 10:10:18.067517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:18.573566 run create_hlr_db(pid=6133): Launched 10:10:18.705251 bus /gobi_6: Setting Powered False 10:10:19.768577 run create_hlr_db(pid=6133): Terminated: ok {rc=0} 10:10:20.199454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6135): Launched 10:10:20.503297 run osmo-hlr_10.42.42.2(pid=6136): Launched 10:10:20.619177 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:21.148758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6138): Launched 10:10:21.450395 run osmo-stp_10.42.42.5(pid=6139): Launched 10:10:21.566261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:10:22.083800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6141): Launched 10:10:22.199854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:10:22.453336 run patchelf(pid=6142): Launched 10:10:22.620622 run osmo-stp_10.42.42.5(pid=6139): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6139)] 10:10:22.748105 run osmo-stp_10.42.42.5(pid=6139): stdout: | (launched: 2022-12-14_10:10:21.394456) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:22.878421 run osmo-stp_10.42.42.5(pid=6139): stderr: | 20221214101021564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101021564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101021564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101021565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101021565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101021565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101021565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:23.010601 run osmo-stp_10.42.42.5(pid=6139): stdout: | (launched: 2022-12-14_10:10:21.394456) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:23.137206 run osmo-stp_10.42.42.5(pid=6139): stderr: | 20221214101021564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101021564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101021564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101021565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101021565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101021565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101021565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:23.287986 run patchelf(pid=6142): Terminating (SIGINT) 10:10:23.463566 run patchelf(pid=6142): Terminated: ok {rc=0} 10:10:23.589968 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=6139): Process ended prematurely: osmo-stp_10.42.42.5(pid=6139) [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6139)] [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:10:23.600200 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:10:23.628127 run osmo-hlr_10.42.42.2(pid=6136): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6136)] 10:10:23.678464 run osmo-hlr_10.42.42.2(pid=6136): stdout: | (launched: 2022-12-14_10:10:20.447357) 10:10:23.731192 run osmo-hlr_10.42.42.2(pid=6136): stderr: | 20221214101020622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101020622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101020622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101020622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101020622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101020622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101020634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101020643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101020643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101020643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:23.784211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6135): Terminating (SIGTERM) 10:10:23.826082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6138): Terminating (SIGTERM) 10:10:23.869184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6141): Terminating (SIGTERM) 10:10:23.913821 --- ParallelTerminationStrategy: PID 6135 died... 10:10:23.935264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6135): Terminated: ok {rc=0} 10:10:23.982183 --- ParallelTerminationStrategy: PID 6138 died... 10:10:24.003308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6138): Terminated: ok {rc=0} 10:10:24.051306 --- ParallelTerminationStrategy: PID 6141 died... 10:10:24.072023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6141): Terminated: ok {rc=0} 10:10:24.160717 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:10:25.449070 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:10:25.456557 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:10:25.477942 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:10:25.517590 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:10:25.573373 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:10:25.594889 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:10:25.631157 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:10:26.185434 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:10:26.192126 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:10:26.204197 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:10:26.264914 tst switch_tch_pdch.py: using LAC 40200 10:10:26.385880 tst switch_tch_pdch.py: using RAC 165 10:10:26.505276 tst switch_tch_pdch.py: using CellId 40200 10:10:26.626375 tst switch_tch_pdch.py: using BVCI 40201 10:10:26.739165 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:10:26.751306 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:10:26.763256 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:10:26.775260 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:10:26.788292 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:10:26.801407 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:10:26.814504 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:10:26.827981 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:10:26.952841 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:10:27.071191 tst switch_tch_pdch.py:51: start network... 10:10:27.289454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:27.789861 run create_hlr_db(pid=6321): Launched 10:10:27.954525 bus /gobi_6: Setting Powered False 10:10:29.017173 run create_hlr_db(pid=6321): Terminated: ok {rc=0} 10:10:29.450348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6324): Launched 10:10:29.752420 run osmo-hlr_10.42.42.2(pid=6325): Launched 10:10:29.868154 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:30.390658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6327): Launched 10:10:30.692105 run osmo-stp_10.42.42.5(pid=6328): Launched 10:10:30.806260 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:10:31.391019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6330): Launched 10:10:31.520287 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:10:31.781794 run patchelf(pid=6331): Launched 10:10:31.969662 run osmo-stp_10.42.42.5(pid=6328): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6328)] 10:10:32.108419 run osmo-stp_10.42.42.5(pid=6328): stdout: | (launched: 2022-12-14_10:10:30.637113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:32.249487 run osmo-stp_10.42.42.5(pid=6328): stderr: | 20221214101030808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101030809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101030809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101030809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101030810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101030810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101030810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:32.387268 run osmo-stp_10.42.42.5(pid=6328): stdout: | (launched: 2022-12-14_10:10:30.637113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:32.518902 run osmo-stp_10.42.42.5(pid=6328): stderr: | 20221214101030808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101030809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101030809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101030809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101030810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101030810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101030810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:32.674404 run patchelf(pid=6331): Terminating (SIGINT) 10:10:32.853614 run patchelf(pid=6331): Terminated: ok {rc=0} 10:10:32.983127 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6328): Process ended prematurely: osmo-stp_10.42.42.5(pid=6328) [trial-2403↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6328)] [trial-2403↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:10:32.993023 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 10:10:33.021441 run osmo-hlr_10.42.42.2(pid=6325): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6325)] 10:10:33.071974 run osmo-hlr_10.42.42.2(pid=6325): stdout: | (launched: 2022-12-14_10:10:29.696274) 10:10:33.124799 run osmo-hlr_10.42.42.2(pid=6325): stderr: | 20221214101029872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101029872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101029872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101029872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101029872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101029872 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101029885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101029893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101029894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101029894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:33.177772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6324): Terminating (SIGTERM) 10:10:33.219906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6327): Terminating (SIGTERM) 10:10:33.262254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6330): Terminating (SIGTERM) 10:10:33.304495 --- ParallelTerminationStrategy: PID 6324 died... 10:10:33.324769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6324): Terminated: ok {rc=0} 10:10:33.371223 --- ParallelTerminationStrategy: PID 6327 died... 10:10:33.390789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6327): Terminated: ok {rc=0} 10:10:33.437103 --- ParallelTerminationStrategy: PID 6330 died... 10:10:33.456663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6330): Terminated: ok {rc=0} 10:10:33.543990 bus /gobi_0: Setting Powered False 10:10:34.642894 bus /gobi_0: Setting Powered False 10:10:35.758728 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:10:36.997989 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:10:37.004349 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:10:37.025485 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:10:37.060696 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:10:37.119918 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:10:37.142312 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:10:37.177309 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:10:37.727142 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:10:37.732707 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:10:37.744197 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:10:37.801148 tst switch_tch_pdch.py: using LAC 40201 10:10:37.924132 tst switch_tch_pdch.py: using RAC 166 10:10:38.047762 tst switch_tch_pdch.py: using CellId 40201 10:10:38.175262 tst switch_tch_pdch.py: using BVCI 40202 10:10:38.292427 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:10:38.303788 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:10:38.314983 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:10:38.326092 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:10:38.337096 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:10:38.348360 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:10:38.359669 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:10:38.370850 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:10:38.487890 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:10:38.607675 tst switch_tch_pdch.py:51: start network... 10:10:38.822751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:39.290087 run create_hlr_db(pid=6337): Launched 10:10:39.423059 bus /gobi_6: Setting Powered False 10:10:40.483042 run create_hlr_db(pid=6337): Terminated: ok {rc=0} 10:10:40.878531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6339): Launched 10:10:41.179361 run osmo-hlr_10.42.42.2(pid=6340): Launched 10:10:41.293858 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:41.818509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6342): Launched 10:10:42.138816 run osmo-stp_10.42.42.5(pid=6343): Launched 10:10:42.262600 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:10:42.784511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6345): Launched 10:10:42.906633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:10:43.177277 run patchelf(pid=6346): Launched 10:10:43.354999 run osmo-stp_10.42.42.5(pid=6343): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6343)] 10:10:43.490374 run osmo-stp_10.42.42.5(pid=6343): stdout: | (launched: 2022-12-14_10:10:42.079942) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:43.627773 run osmo-stp_10.42.42.5(pid=6343): stderr: | 20221214101042271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101042271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101042271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101042272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101042272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101042272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101042272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:43.764911 run osmo-stp_10.42.42.5(pid=6343): stdout: | (launched: 2022-12-14_10:10:42.079942) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:43.895247 run osmo-stp_10.42.42.5(pid=6343): stderr: | 20221214101042271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101042271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101042271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101042272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101042272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101042272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101042272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:44.049596 run patchelf(pid=6346): Terminating (SIGINT) 10:10:44.228365 run patchelf(pid=6346): Terminated: ok {rc=0} 10:10:44.357769 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=6343): Process ended prematurely: osmo-stp_10.42.42.5(pid=6343) [trial-2403↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6343)] [trial-2403↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:10:44.367647 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 10:10:44.395829 run osmo-hlr_10.42.42.2(pid=6340): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6340)] 10:10:44.446542 run osmo-hlr_10.42.42.2(pid=6340): stdout: | (launched: 2022-12-14_10:10:41.123624) 10:10:44.499233 run osmo-hlr_10.42.42.2(pid=6340): stderr: | 20221214101041299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101041299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101041299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101041299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101041299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101041299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101041312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101041320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101041320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101041320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:44.552587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6339): Terminating (SIGTERM) 10:10:44.595382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6342): Terminating (SIGTERM) 10:10:44.637984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6345): Terminating (SIGTERM) 10:10:44.680777 --- ParallelTerminationStrategy: PID 6339 died... 10:10:44.701232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6339): Terminated: ok {rc=0} 10:10:44.748197 --- ParallelTerminationStrategy: PID 6342 died... 10:10:44.768175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6342): Terminated: ok {rc=0} 10:10:44.814917 --- ParallelTerminationStrategy: PID 6345 died... 10:10:44.834787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6345): Terminated: ok {rc=0} 10:10:44.923614 bus /gobi_0: Setting Powered False 10:10:46.021388 bus /gobi_0: Setting Powered False 10:10:47.137206 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_sms:trx-b200 --------------------------------------------------------------------- 10:10:48.368740 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:10:48.373057 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 10:10:48.406446 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 10:10:48.414539 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 10:10:48.467451 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 10:10:48.500432 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 10:10:48.507254 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 10:10:49.045809 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 10:10:49.051074 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 10:10:49.061967 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 10:10:49.111889 tst mo_mt_sms.py: using LAC 40202 10:10:49.228626 tst mo_mt_sms.py: using RAC 167 10:10:49.349616 tst mo_mt_sms.py: using CellId 40202 10:10:49.467534 tst mo_mt_sms.py: using BVCI 40203 10:10:49.584559 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 10:10:49.699943 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 10:10:49.813648 tst mo_mt_sms.py:9: start nitb and bts... 10:10:50.014480 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:10:50.627347 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6350): Launched 10:10:50.929415 run osmo-nitb_10.42.42.2(pid=6351): Launched 10:10:51.097145 run osmo-nitb_10.42.42.2(pid=6351): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6351)] 10:10:51.233572 run osmo-nitb_10.42.42.2(pid=6351): stdout: | (launched: 2022-12-14_10:10:50.873970) 10:10:51.370766 run osmo-nitb_10.42.42.2(pid=6351): stderr: | (launched: 2022-12-14_10:10:50.918606) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:10:51.508005 run osmo-nitb_10.42.42.2(pid=6351): stdout: | (launched: 2022-12-14_10:10:50.873970) 10:10:51.639509 run osmo-nitb_10.42.42.2(pid=6351): stderr: | (launched: 2022-12-14_10:10:50.918606) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6351): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6351) [trial-2403↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6351)] 10:10:52.043663 tst osmo-nitb_10.42.42.2(pid=6351): stdout: | (launched: 2022-12-14_10:10:50.873970) 10:10:52.165456 tst osmo-nitb_10.42.42.2(pid=6351): stderr: | (launched: 2022-12-14_10:10:50.918606) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:10:52.307677 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6351): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6351) [trial-2403↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6351)] [trial-2403↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 10:10:52.316123 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 10:10:52.322896 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6350): Terminating (SIGTERM) 10:10:52.532624 --- ParallelTerminationStrategy: PID 6350 died... 10:10:52.553568 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6350): Terminated: ok {rc=0} 10:10:52.641402 bus /sierra_3: Setting Powered False 10:10:53.743548 bus /sierra_3: Setting Powered False 10:10:54.863661 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 sms:trx-b200 --------------------------------------------------------------------- 10:10:56.062871 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:10:56.067331 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 10:10:56.099667 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 10:10:56.126428 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 10:10:56.178890 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 10:10:56.211758 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 10:10:56.238220 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 10:10:56.786542 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 10:10:56.792799 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:56.803699 tst sms:trx-b200: Using 1 x bts (candidates: 1) 10:10:56.852396 tst mo_mt_sms.py: using LAC 40203 10:10:56.968829 tst mo_mt_sms.py: using RAC 168 10:10:57.084724 tst mo_mt_sms.py: using CellId 40203 10:10:57.200240 tst mo_mt_sms.py: using BVCI 40204 10:10:57.308013 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:57.318644 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:57.329157 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:57.339441 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:57.350166 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:57.361260 tst sms:trx-b200: Using 1 x modem (candidates: 2) 10:10:57.476876 tst sms:trx-b200: Using 1 x modem (candidates: 2) 10:10:57.594515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:58.089722 run create_hlr_db(pid=6355): Launched 10:10:58.221565 bus /sierra_2: Setting Powered False 10:10:59.281425 run create_hlr_db(pid=6355): Terminated: ok {rc=0} 10:10:59.710964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6357): Launched 10:11:00.010150 run osmo-hlr_10.42.42.2(pid=6358): Launched 10:11:00.124198 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:00.699294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6360): Launched 10:11:01.039673 run osmo-stp_10.42.42.5(pid=6361): Launched 10:11:01.279171 run osmo-msc_10.42.42.6: Starting osmo-msc 10:11:01.989382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6363): Launched 10:11:02.320431 run osmo-msc_10.42.42.6(pid=6364): Launched 10:11:02.488879 run osmo-stp_10.42.42.5(pid=6361): ERR: Terminated: ERROR {rc=1} [trial-2403↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6361)] 10:11:02.617935 run osmo-stp_10.42.42.5(pid=6361): stdout: | (launched: 2022-12-14_10:11:00.983726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:02.746021 run osmo-stp_10.42.42.5(pid=6361): stderr: | 20221214101101311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101101312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101101312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101101312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101101318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101101318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101101318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:02.870801 run osmo-stp_10.42.42.5(pid=6361): stdout: | (launched: 2022-12-14_10:11:00.983726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:02.989681 run osmo-stp_10.42.42.5(pid=6361): stderr: | 20221214101101311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101101312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101101312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101101312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101101318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101101318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101101318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:03.132172 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6361): Process ended prematurely: osmo-stp_10.42.42.5(pid=6361) [trial-2403↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6361)] [trial-2403↪sms:trx-b200↪mo_mt_sms.py:16] 10:11:03.140616 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 10:11:03.166768 run osmo-hlr_10.42.42.2(pid=6358): ERR: Terminated: ERROR {rc=237} [trial-2403↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6358)] 10:11:03.215213 run osmo-hlr_10.42.42.2(pid=6358): stdout: | (launched: 2022-12-14_10:10:59.955165) 10:11:03.265258 run osmo-hlr_10.42.42.2(pid=6358): stderr: | 20221214101100129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101100129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101100130 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101100130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101100130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101100130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101100141 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101100150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101100150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101100150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:03.334680 run osmo-msc_10.42.42.6(pid=6364): ERR: Terminated: ERROR {rc=2} [trial-2403↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6364)] 10:11:03.382002 run osmo-msc_10.42.42.6(pid=6364): stdout: | (launched: 2022-12-14_10:11:02.265077) 10:11:03.431937 run osmo-msc_10.42.42.6(pid=6364): stderr: | 20221214101102530 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101102531 DLGLOBAL DEBUG validating counter group 0x7fa3ef1d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101102531 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101102531 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101102531 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101102531 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101102533 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101102533 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101102533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101102534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:11:03.482168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6357): Terminating (SIGTERM) 10:11:03.522969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6360): Terminating (SIGTERM) 10:11:03.563175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6363): Terminating (SIGTERM) 10:11:03.603703 --- ParallelTerminationStrategy: PID 6357 died... 10:11:03.623418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6357): Terminated: ok {rc=0} 10:11:03.668167 --- ParallelTerminationStrategy: PID 6360 died... 10:11:03.687086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6360): Terminated: ok {rc=0} 10:11:03.731635 --- ParallelTerminationStrategy: PID 6363 died... 10:11:03.750880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6363): Terminated: ok {rc=0} 10:11:03.838106 bus /sierra_3: Setting Powered False 10:11:04.938174 bus /sierra_3: Setting Powered False 10:11:06.055782 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_ussd:trx-b200 --------------------------------------------------------------------- 10:11:07.286306 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:11:07.290402 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 10:11:07.323028 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 10:11:07.330277 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 10:11:07.366382 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 10:11:07.399214 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 10:11:07.405895 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 10:11:07.923205 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2403 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 10:11:07.928290 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 10:11:07.939067 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 10:11:07.986548 tst assert_extension.py: using LAC 40204 10:11:08.105625 tst assert_extension.py: using RAC 169 10:11:08.232933 tst assert_extension.py: using CellId 40204 10:11:08.358488 tst assert_extension.py: using BVCI 40205 10:11:08.474722 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 10:11:08.592389 tst assert_extension.py:10: start nitb and bts... 10:11:08.794690 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:11:09.408236 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6369): Launched 10:11:09.709212 run osmo-nitb_10.42.42.2(pid=6370): Launched 10:11:09.875201 run osmo-nitb_10.42.42.2(pid=6370): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6370)] 10:11:10.010386 run osmo-nitb_10.42.42.2(pid=6370): stdout: | (launched: 2022-12-14_10:11:09.653913) 10:11:10.146860 run osmo-nitb_10.42.42.2(pid=6370): stderr: | (launched: 2022-12-14_10:11:09.698423) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:11:10.283241 run osmo-nitb_10.42.42.2(pid=6370): stdout: | (launched: 2022-12-14_10:11:09.653913) 10:11:10.414304 run osmo-nitb_10.42.42.2(pid=6370): stderr: | (launched: 2022-12-14_10:11:09.698423) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6370): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6370) [trial-2403↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6370)] 10:11:10.822702 tst osmo-nitb_10.42.42.2(pid=6370): stdout: | (launched: 2022-12-14_10:11:09.653913) 10:11:10.943674 tst osmo-nitb_10.42.42.2(pid=6370): stderr: | (launched: 2022-12-14_10:11:09.698423) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:11:11.086177 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6370): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6370) [trial-2403↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6370)] [trial-2403↪nitb_ussd:trx-b200↪assert_extension.py:12] 10:11:11.094681 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:11:11.101341 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6369): Terminating (SIGTERM) 10:11:11.310717 --- ParallelTerminationStrategy: PID 6369 died... 10:11:11.331666 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6369): Terminated: ok {rc=0} 10:11:11.418978 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 ussd:trx-b200 --------------------------------------------------------------------- 10:11:12.598020 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:11:12.602986 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 10:11:12.636518 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 10:11:12.664400 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 10:11:12.700359 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 10:11:12.734677 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 10:11:12.762135 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 10:11:13.293690 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2403 ussd:trx-b200 assert_extension.py ---------------------------------------------- 10:11:13.300164 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:11:13.312226 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 10:11:13.364448 tst assert_extension.py: using LAC 40205 10:11:13.483264 tst assert_extension.py: using RAC 170 10:11:13.599628 tst assert_extension.py: using CellId 40205 10:11:13.715387 tst assert_extension.py: using BVCI 40206 10:11:13.823575 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:11:13.834352 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:11:13.844918 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:11:13.855490 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:11:13.866253 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:11:13.876897 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 10:11:13.994922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:14.488520 run create_hlr_db(pid=6374): Launched 10:11:14.620766 bus /sierra_2: Setting Powered False 10:11:15.680697 run create_hlr_db(pid=6374): Terminated: ok {rc=0} 10:11:16.173905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6376): Launched 10:11:16.502592 run osmo-hlr_10.42.42.2(pid=6377): Launched 10:11:16.771052 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:17.383610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6379): Launched 10:11:17.703767 run osmo-stp_10.42.42.5(pid=6380): Launched 10:11:17.827679 run osmo-msc_10.42.42.6: Starting osmo-msc 10:11:18.402685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6382): Launched 10:11:18.721498 run osmo-msc_10.42.42.6(pid=6383): Launched 10:11:18.898665 run osmo-stp_10.42.42.5(pid=6380): ERR: Terminated: ERROR {rc=1} [trial-2403↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6380)] 10:11:19.034223 run osmo-stp_10.42.42.5(pid=6380): stdout: | (launched: 2022-12-14_10:11:17.644748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:19.170763 run osmo-stp_10.42.42.5(pid=6380): stderr: | 20221214101117838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101117838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101117838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101117838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101117839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101117839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101117839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:19.304497 run osmo-stp_10.42.42.5(pid=6380): stdout: | (launched: 2022-12-14_10:11:17.644748) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:19.431282 run osmo-stp_10.42.42.5(pid=6380): stderr: | 20221214101117838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101117838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101117838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101117838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101117839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101117839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101117839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:19.582736 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6380): Process ended prematurely: osmo-stp_10.42.42.5(pid=6380) [trial-2403↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6380)] [trial-2403↪ussd:trx-b200↪assert_extension.py:17] 10:11:19.591841 tst assert_extension.py:17: Test FAILED (6.3 sec) 10:11:19.619803 run osmo-hlr_10.42.42.2(pid=6377): ERR: Terminated: ERROR {rc=237} [trial-2403↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6377)] 10:11:19.670610 run osmo-hlr_10.42.42.2(pid=6377): stdout: | (launched: 2022-12-14_10:11:16.443727) 10:11:19.723215 run osmo-hlr_10.42.42.2(pid=6377): stderr: | 20221214101116678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101116678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101116678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101116678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101116679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101116679 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101116698 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101116711 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101116711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101116711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:19.796397 run osmo-msc_10.42.42.6(pid=6383): ERR: Terminated: ERROR {rc=2} [trial-2403↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6383)] 10:11:19.846739 run osmo-msc_10.42.42.6(pid=6383): stdout: | (launched: 2022-12-14_10:11:18.662932) 10:11:19.899463 run osmo-msc_10.42.42.6(pid=6383): stderr: | 20221214101118984 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101118984 DLGLOBAL DEBUG validating counter group 0x7fab673ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101118984 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101118984 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101118984 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101118985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101118986 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101118987 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101118987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101118987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:11:19.952259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6376): Terminating (SIGTERM) 10:11:19.994601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6379): Terminating (SIGTERM) 10:11:20.037063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6382): Terminating (SIGTERM) 10:11:20.079566 --- ParallelTerminationStrategy: PID 6376 died... 10:11:20.100235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6376): Terminated: ok {rc=0} 10:11:20.146957 --- ParallelTerminationStrategy: PID 6379 died... 10:11:20.167045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6379): Terminated: ok {rc=0} 10:11:20.213560 --- ParallelTerminationStrategy: PID 6382 died... 10:11:20.233355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6382): Terminated: ok {rc=0} 10:11:20.322499 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:11:21.535777 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:11:21.543204 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:11:21.576756 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:11:21.605341 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:11:21.657233 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:11:21.691336 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:11:21.718669 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:11:22.271109 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:11:22.324544 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:11:22.336182 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:11:22.406406 tst mo_mt_call.py: using LAC 40206 10:11:22.532633 tst mo_mt_call.py: using RAC 171 10:11:22.657853 tst mo_mt_call.py: using CellId 40206 10:11:22.784571 tst mo_mt_call.py: using BVCI 40207 10:11:22.902957 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:11:22.914521 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:11:22.925855 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:11:22.937224 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:11:22.948542 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:11:22.959890 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:11:23.078057 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:11:23.198963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:23.702172 run create_hlr_db(pid=6388): Launched 10:11:23.835903 bus /sierra_2: Setting Powered False 10:11:24.899787 run create_hlr_db(pid=6388): Terminated: ok {rc=0} 10:11:25.335909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6390): Launched 10:11:25.643222 run osmo-hlr_10.42.42.2(pid=6391): Launched 10:11:25.761101 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:26.287365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6393): Launched 10:11:26.593016 run osmo-stp_10.42.42.5(pid=6394): Launched 10:11:26.710003 run osmo-msc_10.42.42.6: Starting osmo-msc 10:11:27.261550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6396): Launched 10:11:27.567421 run osmo-msc_10.42.42.6(pid=6397): Launched 10:11:27.737912 run osmo-stp_10.42.42.5(pid=6394): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6394)] 10:11:27.867349 run osmo-stp_10.42.42.5(pid=6394): stdout: | (launched: 2022-12-14_10:11:26.536892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:27.996605 run osmo-stp_10.42.42.5(pid=6394): stderr: | 20221214101126708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101126708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101126709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101126709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101126709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101126710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101126710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:28.124006 run osmo-stp_10.42.42.5(pid=6394): stdout: | (launched: 2022-12-14_10:11:26.536892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:28.245299 run osmo-stp_10.42.42.5(pid=6394): stderr: | 20221214101126708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101126708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101126709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101126709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101126709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101126710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101126710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:28.390017 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6394): Process ended prematurely: osmo-stp_10.42.42.5(pid=6394) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6394)] [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:11:28.398964 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:11:28.425468 run osmo-hlr_10.42.42.2(pid=6391): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6391)] 10:11:28.473969 run osmo-hlr_10.42.42.2(pid=6391): stdout: | (launched: 2022-12-14_10:11:25.586905) 10:11:28.524060 run osmo-hlr_10.42.42.2(pid=6391): stderr: | 20221214101125762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101125762 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101125762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101125762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101125762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101125762 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101125787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101125796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101125796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101125796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:28.594303 run osmo-msc_10.42.42.6(pid=6397): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6397)] 10:11:28.642067 run osmo-msc_10.42.42.6(pid=6397): stdout: | (launched: 2022-12-14_10:11:27.511385) 10:11:28.692122 run osmo-msc_10.42.42.6(pid=6397): stderr: | 20221214101127783 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101127783 DLGLOBAL DEBUG validating counter group 0x7fde825e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101127783 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101127783 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101127783 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101127783 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101127785 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101127786 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101127786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101127786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:11:28.742379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6390): Terminating (SIGTERM) 10:11:28.782516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6393): Terminating (SIGTERM) 10:11:28.822574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6396): Terminating (SIGTERM) 10:11:28.863225 --- ParallelTerminationStrategy: PID 6390 died... 10:11:28.882667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6390): Terminated: ok {rc=0} 10:11:28.926918 --- ParallelTerminationStrategy: PID 6393 died... 10:11:28.945920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6393): Terminated: ok {rc=0} 10:11:28.990508 --- ParallelTerminationStrategy: PID 6396 died... 10:11:29.009536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6396): Terminated: ok {rc=0} 10:11:29.096498 bus /sierra_3: Setting Powered False 10:11:30.195920 bus /sierra_3: Setting Powered False 10:11:31.318186 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:11:32.471298 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:11:32.482985 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:11:32.552877 tst mo_mt_call_osmux.py: using LAC 40207 10:11:32.678400 tst mo_mt_call_osmux.py: using RAC 172 10:11:32.809608 tst mo_mt_call_osmux.py: using CellId 40207 10:11:32.930389 tst mo_mt_call_osmux.py: using BVCI 40208 10:11:33.041232 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:11:33.052204 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:11:33.063144 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:11:33.074030 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:11:33.085277 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:11:33.096278 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:11:33.212903 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:11:33.332623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:33.833729 run create_hlr_db(pid=6399): Launched 10:11:33.966276 bus /sierra_2: Setting Powered False 10:11:35.030230 run create_hlr_db(pid=6399): Terminated: ok {rc=0} 10:11:35.483409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6401): Launched 10:11:35.807673 run osmo-hlr_10.42.42.2(pid=6402): Launched 10:11:35.930958 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:36.488317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6404): Launched 10:11:36.813150 run osmo-stp_10.42.42.5(pid=6405): Launched 10:11:36.939712 run osmo-msc_10.42.42.6: Starting osmo-msc 10:11:37.527726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6407): Launched 10:11:37.854080 run osmo-msc_10.42.42.6(pid=6408): Launched 10:11:38.036122 run osmo-stp_10.42.42.5(pid=6405): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6405)] 10:11:38.172875 run osmo-stp_10.42.42.5(pid=6405): stdout: | (launched: 2022-12-14_10:11:36.753726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:38.310180 run osmo-stp_10.42.42.5(pid=6405): stderr: | 20221214101136949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101136949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101136949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101136950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101136950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101136950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101136950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:38.446715 run osmo-stp_10.42.42.5(pid=6405): stdout: | (launched: 2022-12-14_10:11:36.753726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:38.575959 run osmo-stp_10.42.42.5(pid=6405): stderr: | 20221214101136949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101136949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101136949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101136950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101136950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101136950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101136950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:38.729972 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6405): Process ended prematurely: osmo-stp_10.42.42.5(pid=6405) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6405)] [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:11:38.739566 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:11:38.767944 run osmo-hlr_10.42.42.2(pid=6402): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6402)] 10:11:38.818302 run osmo-hlr_10.42.42.2(pid=6402): stdout: | (launched: 2022-12-14_10:11:35.748227) 10:11:38.870483 run osmo-hlr_10.42.42.2(pid=6402): stderr: | 20221214101135948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101135948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101135948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101135948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101135948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101135949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101135961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101135969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101135969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101135969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:38.943597 run osmo-msc_10.42.42.6(pid=6408): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6408)] 10:11:38.994074 run osmo-msc_10.42.42.6(pid=6408): stdout: | (launched: 2022-12-14_10:11:37.794932) 10:11:39.046292 run osmo-msc_10.42.42.6(pid=6408): stderr: | 20221214101138119 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101138119 DLGLOBAL DEBUG validating counter group 0x7f3ece185c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101138119 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101138119 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101138119 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101138120 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101138121 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101138122 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101138122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101138122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:11:39.098712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6401): Terminating (SIGTERM) 10:11:39.140746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6404): Terminating (SIGTERM) 10:11:39.183087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6407): Terminating (SIGTERM) 10:11:39.225456 --- ParallelTerminationStrategy: PID 6401 died... 10:11:39.245353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6401): Terminated: ok {rc=0} 10:11:39.291519 --- ParallelTerminationStrategy: PID 6404 died... 10:11:39.311091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6404): Terminated: ok {rc=0} 10:11:39.357113 --- ParallelTerminationStrategy: PID 6407 died... 10:11:39.376607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6407): Terminated: ok {rc=0} 10:11:39.464085 bus /sierra_3: Setting Powered False 10:11:40.563724 bus /sierra_3: Setting Powered False 10:11:41.679559 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:11:42.933591 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:11:42.940786 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:11:42.974808 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:11:43.002644 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:11:43.055904 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:11:43.089912 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:11:43.117256 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:11:43.664516 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:11:43.714570 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:11:43.726418 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:11:43.800298 tst mo_mt_call.py: using LAC 40208 10:11:43.920276 tst mo_mt_call.py: using RAC 173 10:11:44.038786 tst mo_mt_call.py: using CellId 40208 10:11:44.156598 tst mo_mt_call.py: using BVCI 40209 10:11:44.266601 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:11:44.277674 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:11:44.288557 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:11:44.299336 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:11:44.310537 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:11:44.321832 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:11:44.437248 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:11:44.556900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:45.061280 run create_hlr_db(pid=6414): Launched 10:11:45.194754 bus /sierra_2: Setting Powered False 10:11:46.259599 run create_hlr_db(pid=6414): Terminated: ok {rc=0} 10:11:46.722439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6416): Launched 10:11:47.065859 run osmo-hlr_10.42.42.2(pid=6417): Launched 10:11:47.265318 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:47.787485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6419): Launched 10:11:48.094848 run osmo-stp_10.42.42.5(pid=6420): Launched 10:11:48.211867 run osmo-msc_10.42.42.6: Starting osmo-msc 10:11:48.763283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6422): Launched 10:11:49.069588 run osmo-msc_10.42.42.6(pid=6423): Launched 10:11:49.240282 run osmo-stp_10.42.42.5(pid=6420): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6420)] 10:11:49.370557 run osmo-stp_10.42.42.5(pid=6420): stdout: | (launched: 2022-12-14_10:11:48.038955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:49.499592 run osmo-stp_10.42.42.5(pid=6420): stderr: | 20221214101148210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101148211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101148211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101148211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101148212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101148212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101148212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:49.626910 run osmo-stp_10.42.42.5(pid=6420): stdout: | (launched: 2022-12-14_10:11:48.038955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:49.748297 run osmo-stp_10.42.42.5(pid=6420): stderr: | 20221214101148210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101148211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101148211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101148211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101148212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101148212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101148212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:49.893651 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6420): Process ended prematurely: osmo-stp_10.42.42.5(pid=6420) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6420)] [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:11:49.902847 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:11:49.929697 run osmo-hlr_10.42.42.2(pid=6417): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6417)] 10:11:49.979221 run osmo-hlr_10.42.42.2(pid=6417): stdout: | (launched: 2022-12-14_10:11:47.006153) 10:11:50.029701 run osmo-hlr_10.42.42.2(pid=6417): stderr: | 20221214101147201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101147201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101147201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101147201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101147201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101147201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101147214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101147224 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101147224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101147224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:50.100402 run osmo-msc_10.42.42.6(pid=6423): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6423)] 10:11:50.148768 run osmo-msc_10.42.42.6(pid=6423): stdout: | (launched: 2022-12-14_10:11:49.013220) 10:11:50.199411 run osmo-msc_10.42.42.6(pid=6423): stderr: | 20221214101149284 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101149285 DLGLOBAL DEBUG validating counter group 0x7f1d21206c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101149285 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101149285 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101149285 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101149285 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101149287 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101149287 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101149287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101149287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:11:50.250274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6416): Terminating (SIGTERM) 10:11:50.291256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6419): Terminating (SIGTERM) 10:11:50.332308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6422): Terminating (SIGTERM) 10:11:50.374008 --- ParallelTerminationStrategy: PID 6416 died... 10:11:50.393708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6416): Terminated: ok {rc=0} 10:11:50.438611 --- ParallelTerminationStrategy: PID 6419 died... 10:11:50.457698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6419): Terminated: ok {rc=0} 10:11:50.502371 --- ParallelTerminationStrategy: PID 6422 died... 10:11:50.521544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6422): Terminated: ok {rc=0} 10:11:50.608255 bus /sierra_3: Setting Powered False 10:11:51.708690 bus /sierra_3: Setting Powered False 10:11:52.825229 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:11:53.976506 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:11:53.988719 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:11:54.060794 tst mo_mt_call_osmux.py: using LAC 40209 10:11:54.189975 tst mo_mt_call_osmux.py: using RAC 174 10:11:54.317091 tst mo_mt_call_osmux.py: using CellId 40209 10:11:54.444792 tst mo_mt_call_osmux.py: using BVCI 40210 10:11:54.562437 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:11:54.574004 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:11:54.585509 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:11:54.596788 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:11:54.608270 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:11:54.619672 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:11:54.738762 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:11:54.858271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:55.333826 run create_hlr_db(pid=6425): Launched 10:11:55.452079 bus /sierra_2: Setting Powered False 10:11:56.513590 run create_hlr_db(pid=6425): Terminated: ok {rc=0} 10:11:56.960412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6427): Launched 10:11:57.286509 run osmo-hlr_10.42.42.2(pid=6428): Launched 10:11:57.411432 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:57.975101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6430): Launched 10:11:58.301496 run osmo-stp_10.42.42.5(pid=6431): Launched 10:11:58.424837 run osmo-msc_10.42.42.6: Starting osmo-msc 10:11:59.019150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6433): Launched 10:11:59.347410 run osmo-msc_10.42.42.6(pid=6434): Launched 10:11:59.531133 run osmo-stp_10.42.42.5(pid=6431): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6431)] 10:11:59.667697 run osmo-stp_10.42.42.5(pid=6431): stdout: | (launched: 2022-12-14_10:11:58.242009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:59.811067 run osmo-stp_10.42.42.5(pid=6431): stderr: | 20221214101158434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101158434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101158435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101158435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101158435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101158436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101158436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:59.946608 run osmo-stp_10.42.42.5(pid=6431): stdout: | (launched: 2022-12-14_10:11:58.242009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:00.075675 run osmo-stp_10.42.42.5(pid=6431): stderr: | 20221214101158434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101158434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101158435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101158435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101158435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101158436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101158436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:00.230829 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6431): Process ended prematurely: osmo-stp_10.42.42.5(pid=6431) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6431)] [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:12:00.240328 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:12:00.268370 run osmo-hlr_10.42.42.2(pid=6428): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6428)] 10:12:00.318889 run osmo-hlr_10.42.42.2(pid=6428): stdout: | (launched: 2022-12-14_10:11:57.227232) 10:12:00.371505 run osmo-hlr_10.42.42.2(pid=6428): stderr: | 20221214101157425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101157425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101157426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101157426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101157426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101157426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101157439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101157447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101157447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101157447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:00.444303 run osmo-msc_10.42.42.6(pid=6434): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6434)] 10:12:00.494692 run osmo-msc_10.42.42.6(pid=6434): stdout: | (launched: 2022-12-14_10:11:59.287685) 10:12:00.547168 run osmo-msc_10.42.42.6(pid=6434): stderr: | 20221214101159609 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101159609 DLGLOBAL DEBUG validating counter group 0x7ff58e919c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101159609 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101159609 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101159610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101159610 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101159611 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101159612 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101159612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101159612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:12:00.599948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6427): Terminating (SIGTERM) 10:12:00.642274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6430): Terminating (SIGTERM) 10:12:00.684388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6433): Terminating (SIGTERM) 10:12:00.726805 --- ParallelTerminationStrategy: PID 6427 died... 10:12:00.747033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6427): Terminated: ok {rc=0} 10:12:00.793394 --- ParallelTerminationStrategy: PID 6430 died... 10:12:00.812889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6430): Terminated: ok {rc=0} 10:12:00.859877 --- ParallelTerminationStrategy: PID 6433 died... 10:12:00.890126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6433): Terminated: ok {rc=0} 10:12:00.981825 bus /sierra_3: Setting Powered False 10:12:02.097947 bus /sierra_3: Setting Powered False 10:12:03.228547 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:12:04.476726 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:12:04.483293 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:12:04.515585 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:12:04.543194 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:12:04.595413 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:12:04.629000 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:12:04.656009 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:12:05.209085 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:12:05.261560 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:12:05.273092 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:12:05.343793 tst mo_mt_call.py: using LAC 40210 10:12:05.464513 tst mo_mt_call.py: using RAC 175 10:12:05.586549 tst mo_mt_call.py: using CellId 40210 10:12:05.708292 tst mo_mt_call.py: using BVCI 40211 10:12:05.818642 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:12:05.829735 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:12:05.840437 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:12:05.851219 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:12:05.862415 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:12:05.873626 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:12:05.994200 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:12:06.114322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:06.619692 run create_hlr_db(pid=6439): Launched 10:12:06.752340 bus /sierra_2: Setting Powered False 10:12:07.816676 run create_hlr_db(pid=6439): Terminated: ok {rc=0} 10:12:08.270815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6441): Launched 10:12:08.597106 run osmo-hlr_10.42.42.2(pid=6442): Launched 10:12:08.722615 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:09.282135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6444): Launched 10:12:09.609192 run osmo-stp_10.42.42.5(pid=6445): Launched 10:12:09.734496 run osmo-msc_10.42.42.6: Starting osmo-msc 10:12:10.322237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6447): Launched 10:12:10.649307 run osmo-msc_10.42.42.6(pid=6448): Launched 10:12:10.832071 run osmo-stp_10.42.42.5(pid=6445): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6445)] 10:12:10.968685 run osmo-stp_10.42.42.5(pid=6445): stdout: | (launched: 2022-12-14_10:12:09.549329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:11.105349 run osmo-stp_10.42.42.5(pid=6445): stderr: | 20221214101209742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101209743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101209743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101209743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101209744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101209744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101209744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:11.242717 run osmo-stp_10.42.42.5(pid=6445): stdout: | (launched: 2022-12-14_10:12:09.549329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:11.371765 run osmo-stp_10.42.42.5(pid=6445): stderr: | 20221214101209742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101209743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101209743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101209743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101209744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101209744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101209744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:11.526507 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6445): Process ended prematurely: osmo-stp_10.42.42.5(pid=6445) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6445)] [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:12:11.536166 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:12:11.564172 run osmo-hlr_10.42.42.2(pid=6442): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6442)] 10:12:11.614347 run osmo-hlr_10.42.42.2(pid=6442): stdout: | (launched: 2022-12-14_10:12:08.537527) 10:12:11.666602 run osmo-hlr_10.42.42.2(pid=6442): stderr: | 20221214101208737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101208737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101208737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101208737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101208737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101208737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101208750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101208758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101208758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101208758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:11.738647 run osmo-msc_10.42.42.6(pid=6448): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6448)] 10:12:11.788655 run osmo-msc_10.42.42.6(pid=6448): stdout: | (launched: 2022-12-14_10:12:10.589574) 10:12:11.840577 run osmo-msc_10.42.42.6(pid=6448): stderr: | 20221214101210913 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101210913 DLGLOBAL DEBUG validating counter group 0x7f0dfda60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101210913 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101210913 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101210913 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101210914 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101210915 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101210916 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101210916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101210916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:12:11.893288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6441): Terminating (SIGTERM) 10:12:11.935188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6444): Terminating (SIGTERM) 10:12:11.977216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6447): Terminating (SIGTERM) 10:12:12.019310 --- ParallelTerminationStrategy: PID 6441 died... 10:12:12.038995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6441): Terminated: ok {rc=0} 10:12:12.085384 --- ParallelTerminationStrategy: PID 6444 died... 10:12:12.104803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6444): Terminated: ok {rc=0} 10:12:12.151267 --- ParallelTerminationStrategy: PID 6447 died... 10:12:12.170858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6447): Terminated: ok {rc=0} 10:12:12.260401 bus /sierra_3: Setting Powered False 10:12:13.360103 bus /sierra_3: Setting Powered False 10:12:14.478035 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:12:15.628026 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:12:15.640242 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:12:15.711759 tst mo_mt_call_osmux.py: using LAC 40211 10:12:15.847734 tst mo_mt_call_osmux.py: using RAC 176 10:12:15.987264 tst mo_mt_call_osmux.py: using CellId 40211 10:12:16.110320 tst mo_mt_call_osmux.py: using BVCI 40212 10:12:16.225377 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:12:16.237680 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:12:16.250221 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:12:16.262222 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:12:16.275379 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:12:16.288458 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:12:16.409050 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:12:16.529682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:17.042617 run create_hlr_db(pid=6450): Launched 10:12:17.205031 bus /sierra_2: Setting Powered False 10:12:18.269882 run create_hlr_db(pid=6450): Terminated: ok {rc=0} 10:12:18.722598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6452): Launched 10:12:19.048606 run osmo-hlr_10.42.42.2(pid=6453): Launched 10:12:19.171735 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:19.734798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6455): Launched 10:12:20.062173 run osmo-stp_10.42.42.5(pid=6456): Launched 10:12:20.187285 run osmo-msc_10.42.42.6: Starting osmo-msc 10:12:20.773664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6458): Launched 10:12:21.100325 run osmo-msc_10.42.42.6(pid=6459): Launched 10:12:21.283373 run osmo-stp_10.42.42.5(pid=6456): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6456)] 10:12:21.420092 run osmo-stp_10.42.42.5(pid=6456): stdout: | (launched: 2022-12-14_10:12:20.002449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:21.557323 run osmo-stp_10.42.42.5(pid=6456): stderr: | 20221214101220197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101220197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101220197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101220198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101220198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101220198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101220198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:21.693744 run osmo-stp_10.42.42.5(pid=6456): stdout: | (launched: 2022-12-14_10:12:20.002449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:21.822406 run osmo-stp_10.42.42.5(pid=6456): stderr: | 20221214101220197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101220197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101220197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101220198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101220198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101220198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101220198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:21.977123 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6456): Process ended prematurely: osmo-stp_10.42.42.5(pid=6456) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6456)] [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:12:21.986826 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:12:22.014789 run osmo-hlr_10.42.42.2(pid=6453): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6453)] 10:12:22.065142 run osmo-hlr_10.42.42.2(pid=6453): stdout: | (launched: 2022-12-14_10:12:18.989236) 10:12:22.117267 run osmo-hlr_10.42.42.2(pid=6453): stderr: | 20221214101219188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101219188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101219188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101219188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101219188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101219188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101219200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101219208 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101219208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101219209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:22.190025 run osmo-msc_10.42.42.6(pid=6459): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6459)] 10:12:22.240338 run osmo-msc_10.42.42.6(pid=6459): stdout: | (launched: 2022-12-14_10:12:21.040687) 10:12:22.292103 run osmo-msc_10.42.42.6(pid=6459): stderr: | 20221214101221363 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101221364 DLGLOBAL DEBUG validating counter group 0x7f2b017eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101221364 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101221364 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101221364 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101221364 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101221366 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101221366 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101221366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101221366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:12:22.344331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6452): Terminating (SIGTERM) 10:12:22.386329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6455): Terminating (SIGTERM) 10:12:22.428219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6458): Terminating (SIGTERM) 10:12:22.470670 --- ParallelTerminationStrategy: PID 6452 died... 10:12:22.491041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6452): Terminated: ok {rc=0} 10:12:22.537325 --- ParallelTerminationStrategy: PID 6455 died... 10:12:22.556810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6455): Terminated: ok {rc=0} 10:12:22.602911 --- ParallelTerminationStrategy: PID 6458 died... 10:12:22.622481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6458): Terminated: ok {rc=0} 10:12:22.711846 bus /sierra_3: Setting Powered False 10:12:23.811369 bus /sierra_3: Setting Powered False 10:12:24.927381 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:12:26.180824 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:12:26.188323 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:12:26.221926 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:12:26.249770 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:12:26.305158 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:12:26.338678 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:12:26.365420 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:12:26.915744 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:12:26.966534 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:12:26.977691 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:12:27.047201 tst mo_mt_call.py: using LAC 40212 10:12:27.166640 tst mo_mt_call.py: using RAC 177 10:12:27.287081 tst mo_mt_call.py: using CellId 40212 10:12:27.406854 tst mo_mt_call.py: using BVCI 40213 10:12:27.519088 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:12:27.530283 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:12:27.541079 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:12:27.551852 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:12:27.563437 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:12:27.574661 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:12:27.695528 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:12:27.813376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:28.287596 run create_hlr_db(pid=6465): Launched 10:12:28.404309 bus /sierra_2: Setting Powered False 10:12:29.465412 run create_hlr_db(pid=6465): Terminated: ok {rc=0} 10:12:29.914696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6467): Launched 10:12:30.242253 run osmo-hlr_10.42.42.2(pid=6468): Launched 10:12:30.367541 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:30.931103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6470): Launched 10:12:31.299631 run osmo-stp_10.42.42.5(pid=6471): Launched 10:12:31.541260 run osmo-msc_10.42.42.6: Starting osmo-msc 10:12:32.272622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6473): Launched 10:12:32.594577 run osmo-msc_10.42.42.6(pid=6474): Launched 10:12:32.767336 run osmo-stp_10.42.42.5(pid=6471): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6471)] 10:12:32.897578 run osmo-stp_10.42.42.5(pid=6471): stdout: | (launched: 2022-12-14_10:12:31.237924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:33.029320 run osmo-stp_10.42.42.5(pid=6471): stderr: | 20221214101231570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101231571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101231571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101231571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101231572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101231579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101231579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:33.157678 run osmo-stp_10.42.42.5(pid=6471): stdout: | (launched: 2022-12-14_10:12:31.237924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:33.279419 run osmo-stp_10.42.42.5(pid=6471): stderr: | 20221214101231570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101231571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101231571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101231571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101231572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101231579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101231579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:33.425208 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6471): Process ended prematurely: osmo-stp_10.42.42.5(pid=6471) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6471)] [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:12:33.434325 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:12:33.460827 run osmo-hlr_10.42.42.2(pid=6468): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6468)] 10:12:33.509258 run osmo-hlr_10.42.42.2(pid=6468): stdout: | (launched: 2022-12-14_10:12:30.182395) 10:12:33.559452 run osmo-hlr_10.42.42.2(pid=6468): stderr: | 20221214101230381 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101230381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101230381 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101230381 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101230381 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101230381 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101230394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101230404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101230404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101230404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:33.628819 run osmo-msc_10.42.42.6(pid=6474): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6474)] 10:12:33.676703 run osmo-msc_10.42.42.6(pid=6474): stdout: | (launched: 2022-12-14_10:12:32.537877) 10:12:33.726740 run osmo-msc_10.42.42.6(pid=6474): stderr: | 20221214101232811 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101232811 DLGLOBAL DEBUG validating counter group 0x7f7d37cbcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101232811 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101232811 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101232811 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101232811 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101232813 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101232813 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101232814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101232814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:12:33.777171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6467): Terminating (SIGTERM) 10:12:33.817364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6470): Terminating (SIGTERM) 10:12:33.857356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6473): Terminating (SIGTERM) 10:12:33.897508 --- ParallelTerminationStrategy: PID 6467 died... 10:12:33.917337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6467): Terminated: ok {rc=0} 10:12:33.961569 --- ParallelTerminationStrategy: PID 6470 died... 10:12:33.980717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6470): Terminated: ok {rc=0} 10:12:34.025260 --- ParallelTerminationStrategy: PID 6473 died... 10:12:34.044156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6473): Terminated: ok {rc=0} 10:12:34.132512 bus /sierra_3: Setting Powered False 10:12:35.233109 bus /sierra_3: Setting Powered False 10:12:36.350315 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:12:37.498333 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:12:37.510161 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:12:37.580291 tst mo_mt_call_osmux.py: using LAC 40213 10:12:37.700572 tst mo_mt_call_osmux.py: using RAC 178 10:12:37.819100 tst mo_mt_call_osmux.py: using CellId 40213 10:12:37.939961 tst mo_mt_call_osmux.py: using BVCI 40214 10:12:38.051596 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:12:38.062705 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:12:38.073587 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:12:38.084361 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:12:38.095672 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:12:38.106857 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:12:38.223984 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:12:38.346574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:38.850264 run create_hlr_db(pid=6476): Launched 10:12:38.984170 bus /sierra_2: Setting Powered False 10:12:40.048912 run create_hlr_db(pid=6476): Terminated: ok {rc=0} 10:12:40.503727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6478): Launched 10:12:40.829756 run osmo-hlr_10.42.42.2(pid=6479): Launched 10:12:40.953245 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:41.517481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6481): Launched 10:12:41.842869 run osmo-stp_10.42.42.5(pid=6482): Launched 10:12:41.967616 run osmo-msc_10.42.42.6: Starting osmo-msc 10:12:42.556209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6484): Launched 10:12:42.881948 run osmo-msc_10.42.42.6(pid=6485): Launched 10:12:43.069050 run osmo-stp_10.42.42.5(pid=6482): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6482)] 10:12:43.206649 run osmo-stp_10.42.42.5(pid=6482): stdout: | (launched: 2022-12-14_10:12:41.783568) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:43.344340 run osmo-stp_10.42.42.5(pid=6482): stderr: | 20221214101241976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101241976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101241976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101241977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101241977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101241977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101241977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:43.481728 run osmo-stp_10.42.42.5(pid=6482): stdout: | (launched: 2022-12-14_10:12:41.783568) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:43.610907 run osmo-stp_10.42.42.5(pid=6482): stderr: | 20221214101241976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101241976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101241976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101241977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101241977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101241977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101241977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:43.765604 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6482): Process ended prematurely: osmo-stp_10.42.42.5(pid=6482) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6482)] [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:12:43.775447 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:12:43.803651 run osmo-hlr_10.42.42.2(pid=6479): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6479)] 10:12:43.854422 run osmo-hlr_10.42.42.2(pid=6479): stdout: | (launched: 2022-12-14_10:12:40.769895) 10:12:43.906811 run osmo-hlr_10.42.42.2(pid=6479): stderr: | 20221214101240971 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101240971 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101240971 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101240971 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101240971 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101240971 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101240983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101240991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101240992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101240992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:43.980237 run osmo-msc_10.42.42.6(pid=6485): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6485)] 10:12:44.030618 run osmo-msc_10.42.42.6(pid=6485): stdout: | (launched: 2022-12-14_10:12:42.822330) 10:12:44.083002 run osmo-msc_10.42.42.6(pid=6485): stderr: | 20221214101243149 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101243149 DLGLOBAL DEBUG validating counter group 0x7fd85c96ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101243149 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101243149 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101243150 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101243150 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101243151 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101243152 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101243152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101243152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:12:44.135485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6478): Terminating (SIGTERM) 10:12:44.177885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6481): Terminating (SIGTERM) 10:12:44.220622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6484): Terminating (SIGTERM) 10:12:44.263973 --- ParallelTerminationStrategy: PID 6478 died... 10:12:44.284566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6478): Terminated: ok {rc=0} 10:12:44.332041 --- ParallelTerminationStrategy: PID 6481 died... 10:12:44.352119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6481): Terminated: ok {rc=0} 10:12:44.398737 --- ParallelTerminationStrategy: PID 6484 died... 10:12:44.418593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6484): Terminated: ok {rc=0} 10:12:44.507506 bus /sierra_3: Setting Powered False 10:12:45.603141 bus /sierra_3: Setting Powered False 10:12:46.716648 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:12:47.970367 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:12:47.977389 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:12:48.011333 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:12:48.039027 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:12:48.090477 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:12:48.124109 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:12:48.151321 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:12:48.704178 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:12:48.754010 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:12:48.765246 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:12:48.833282 tst mo_mt_call.py: using LAC 40214 10:12:48.953699 tst mo_mt_call.py: using RAC 179 10:12:49.073970 tst mo_mt_call.py: using CellId 40214 10:12:49.196275 tst mo_mt_call.py: using BVCI 40215 10:12:49.308141 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:12:49.319431 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:12:49.330314 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:12:49.341847 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:12:49.353606 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:12:49.365187 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:12:49.484781 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:12:49.603902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:50.075447 run create_hlr_db(pid=6490): Launched 10:12:50.192827 bus /sierra_2: Setting Powered False 10:12:51.253896 run create_hlr_db(pid=6490): Terminated: ok {rc=0} 10:12:51.700284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6492): Launched 10:12:52.024867 run osmo-hlr_10.42.42.2(pid=6493): Launched 10:12:52.149213 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:52.707583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6495): Launched 10:12:53.034710 run osmo-stp_10.42.42.5(pid=6496): Launched 10:12:53.161453 run osmo-msc_10.42.42.6: Starting osmo-msc 10:12:53.752138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6498): Launched 10:12:54.076773 run osmo-msc_10.42.42.6(pid=6499): Launched 10:12:54.259664 run osmo-stp_10.42.42.5(pid=6496): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6496)] 10:12:54.396383 run osmo-stp_10.42.42.5(pid=6496): stdout: | (launched: 2022-12-14_10:12:52.975069) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:54.533700 run osmo-stp_10.42.42.5(pid=6496): stderr: | 20221214101253167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101253167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101253168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101253168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101253168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101253168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101253169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:54.670121 run osmo-stp_10.42.42.5(pid=6496): stdout: | (launched: 2022-12-14_10:12:52.975069) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:54.798931 run osmo-stp_10.42.42.5(pid=6496): stderr: | 20221214101253167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101253167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101253168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101253168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101253168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101253168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101253169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:54.952796 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6496): Process ended prematurely: osmo-stp_10.42.42.5(pid=6496) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6496)] [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:12:54.962540 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:12:54.990549 run osmo-hlr_10.42.42.2(pid=6493): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6493)] 10:12:55.041155 run osmo-hlr_10.42.42.2(pid=6493): stdout: | (launched: 2022-12-14_10:12:51.965451) 10:12:55.093450 run osmo-hlr_10.42.42.2(pid=6493): stderr: | 20221214101252164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101252164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101252164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101252164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101252164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101252164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101252176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101252184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101252185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101252185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:55.166582 run osmo-msc_10.42.42.6(pid=6499): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6499)] 10:12:55.217480 run osmo-msc_10.42.42.6(pid=6499): stdout: | (launched: 2022-12-14_10:12:54.017188) 10:12:55.269722 run osmo-msc_10.42.42.6(pid=6499): stderr: | 20221214101254340 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101254340 DLGLOBAL DEBUG validating counter group 0x7f918a1e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101254340 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101254340 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101254340 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101254341 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101254342 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101254343 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101254343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101254343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:12:55.322248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6492): Terminating (SIGTERM) 10:12:55.364224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6495): Terminating (SIGTERM) 10:12:55.406359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6498): Terminating (SIGTERM) 10:12:55.448556 --- ParallelTerminationStrategy: PID 6492 died... 10:12:55.469000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6492): Terminated: ok {rc=0} 10:12:55.515374 --- ParallelTerminationStrategy: PID 6495 died... 10:12:55.535528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6495): Terminated: ok {rc=0} 10:12:55.582342 --- ParallelTerminationStrategy: PID 6498 died... 10:12:55.602039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6498): Terminated: ok {rc=0} 10:12:55.689775 bus /sierra_3: Setting Powered False 10:12:56.789373 bus /sierra_3: Setting Powered False 10:12:57.910654 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:12:59.061684 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:12:59.073875 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:12:59.145301 tst mo_mt_call_osmux.py: using LAC 40215 10:12:59.274100 tst mo_mt_call_osmux.py: using RAC 180 10:12:59.399185 tst mo_mt_call_osmux.py: using CellId 40215 10:12:59.527259 tst mo_mt_call_osmux.py: using BVCI 40216 10:12:59.639704 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:12:59.651067 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:12:59.662166 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:12:59.673228 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:12:59.685102 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:12:59.696667 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:12:59.818096 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:12:59.939746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:00.446059 run create_hlr_db(pid=6501): Launched 10:13:00.581911 bus /sierra_2: Setting Powered False 10:13:01.646231 run create_hlr_db(pid=6501): Terminated: ok {rc=0} 10:13:02.111547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6503): Launched 10:13:02.450279 run osmo-hlr_10.42.42.2(pid=6504): Launched 10:13:02.577343 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:03.143497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6506): Launched 10:13:03.473368 run osmo-stp_10.42.42.5(pid=6507): Launched 10:13:03.599384 run osmo-msc_10.42.42.6: Starting osmo-msc 10:13:04.189461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6509): Launched 10:13:04.518614 run osmo-msc_10.42.42.6(pid=6510): Launched 10:13:04.701544 run osmo-stp_10.42.42.5(pid=6507): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6507)] 10:13:04.838858 run osmo-stp_10.42.42.5(pid=6507): stdout: | (launched: 2022-12-14_10:13:03.413713) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:04.976738 run osmo-stp_10.42.42.5(pid=6507): stderr: | 20221214101303607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101303607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101303608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101303608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101303608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101303609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101303609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:05.114426 run osmo-stp_10.42.42.5(pid=6507): stdout: | (launched: 2022-12-14_10:13:03.413713) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:05.244549 run osmo-stp_10.42.42.5(pid=6507): stderr: | 20221214101303607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101303607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101303608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101303608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101303608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101303609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101303609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:05.399877 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6507): Process ended prematurely: osmo-stp_10.42.42.5(pid=6507) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6507)] [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:13:05.409639 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:13:05.437621 run osmo-hlr_10.42.42.2(pid=6504): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6504)] 10:13:05.487955 run osmo-hlr_10.42.42.2(pid=6504): stdout: | (launched: 2022-12-14_10:13:02.390022) 10:13:05.540046 run osmo-hlr_10.42.42.2(pid=6504): stderr: | 20221214101302590 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101302591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101302591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101302591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101302591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101302591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101302603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101302611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101302611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101302611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:05.613120 run osmo-msc_10.42.42.6(pid=6510): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6510)] 10:13:05.663412 run osmo-msc_10.42.42.6(pid=6510): stdout: | (launched: 2022-12-14_10:13:04.458794) 10:13:05.715290 run osmo-msc_10.42.42.6(pid=6510): stderr: | 20221214101304782 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101304782 DLGLOBAL DEBUG validating counter group 0x7f2f5c62bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101304782 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101304782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101304783 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101304783 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101304784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101304785 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101304785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101304785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:13:05.767585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6503): Terminating (SIGTERM) 10:13:05.809759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6506): Terminating (SIGTERM) 10:13:05.852339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6509): Terminating (SIGTERM) 10:13:05.894705 --- ParallelTerminationStrategy: PID 6503 died... 10:13:05.915046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6503): Terminated: ok {rc=0} 10:13:05.961649 --- ParallelTerminationStrategy: PID 6506 died... 10:13:05.981351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6506): Terminated: ok {rc=0} 10:13:06.027497 --- ParallelTerminationStrategy: PID 6509 died... 10:13:06.047240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6509): Terminated: ok {rc=0} 10:13:06.136615 bus /sierra_3: Setting Powered False 10:13:07.236029 bus /sierra_3: Setting Powered False 10:13:08.354363 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:13:09.603084 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:13:09.609820 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:13:09.642890 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:13:09.670453 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:13:09.723020 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:13:09.757795 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:13:09.785996 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:13:10.335891 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:13:10.386207 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:13:10.397429 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:13:10.470714 tst mo_mt_call.py: using LAC 40216 10:13:10.589870 tst mo_mt_call.py: using RAC 181 10:13:10.710093 tst mo_mt_call.py: using CellId 40216 10:13:10.829208 tst mo_mt_call.py: using BVCI 40217 10:13:10.939732 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:13:10.950942 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:13:10.962031 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:13:10.972878 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:13:10.984253 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:13:10.995465 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:13:11.113097 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:13:11.233911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:11.738121 run create_hlr_db(pid=6515): Launched 10:13:11.871975 bus /sierra_2: Setting Powered False 10:13:12.936730 run create_hlr_db(pid=6515): Terminated: ok {rc=0} 10:13:13.371238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6517): Launched 10:13:13.677397 run osmo-hlr_10.42.42.2(pid=6518): Launched 10:13:13.794071 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:14.332273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6520): Launched 10:13:14.637546 run osmo-stp_10.42.42.5(pid=6521): Launched 10:13:14.755117 run osmo-msc_10.42.42.6: Starting osmo-msc 10:13:15.305730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6523): Launched 10:13:15.610577 run osmo-msc_10.42.42.6(pid=6524): Launched 10:13:15.781194 run osmo-stp_10.42.42.5(pid=6521): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6521)] 10:13:16.017621 run osmo-stp_10.42.42.5(pid=6521): stdout: | (launched: 2022-12-14_10:13:14.581765) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:16.176742 run osmo-stp_10.42.42.5(pid=6521): stderr: | 20221214101314752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101314752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101314752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101314753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101314753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101314753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101314753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:16.316016 run osmo-stp_10.42.42.5(pid=6521): stdout: | (launched: 2022-12-14_10:13:14.581765) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:16.449814 run osmo-stp_10.42.42.5(pid=6521): stderr: | 20221214101314752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101314752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101314752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101314753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101314753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101314753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101314753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:16.609691 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6521): Process ended prematurely: osmo-stp_10.42.42.5(pid=6521) [trial-2403↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6521)] [trial-2403↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:13:16.620447 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:13:16.650077 run osmo-hlr_10.42.42.2(pid=6518): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6518)] 10:13:16.703115 run osmo-hlr_10.42.42.2(pid=6518): stdout: | (launched: 2022-12-14_10:13:13.620798) 10:13:16.758290 run osmo-hlr_10.42.42.2(pid=6518): stderr: | 20221214101313799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101313799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101313799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101313799 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101313799 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101313799 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101313812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101313820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101313820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101313820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:16.832998 run osmo-msc_10.42.42.6(pid=6524): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6524)] 10:13:16.884398 run osmo-msc_10.42.42.6(pid=6524): stdout: | (launched: 2022-12-14_10:13:15.554149) 10:13:16.938724 run osmo-msc_10.42.42.6(pid=6524): stderr: | 20221214101315825 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101315825 DLGLOBAL DEBUG validating counter group 0x7f6d74dccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101315825 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101315825 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101315825 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101315825 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101315827 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101315827 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101315828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101315828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:13:16.994738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6517): Terminating (SIGTERM) 10:13:17.038218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6520): Terminating (SIGTERM) 10:13:17.083424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6523): Terminating (SIGTERM) 10:13:17.128599 --- ParallelTerminationStrategy: PID 6517 died... 10:13:17.150837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6517): Terminated: ok {rc=0} 10:13:17.199323 --- ParallelTerminationStrategy: PID 6520 died... 10:13:17.220212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6520): Terminated: ok {rc=0} 10:13:17.266506 --- ParallelTerminationStrategy: PID 6523 died... 10:13:17.286201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6523): Terminated: ok {rc=0} 10:13:17.375078 bus /sierra_3: Setting Powered False 10:13:18.472864 bus /sierra_3: Setting Powered False 10:13:19.588503 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:13:20.737496 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:13:20.750104 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:13:20.821502 tst mo_mt_call_osmux.py: using LAC 40217 10:13:20.948707 tst mo_mt_call_osmux.py: using RAC 182 10:13:21.088374 tst mo_mt_call_osmux.py: using CellId 40217 10:13:21.220556 tst mo_mt_call_osmux.py: using BVCI 40218 10:13:21.339789 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:13:21.351466 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:13:21.362874 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:13:21.374249 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:13:21.385700 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:13:21.397104 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:13:21.515393 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:13:21.635687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:22.140522 run create_hlr_db(pid=6526): Launched 10:13:22.273512 bus /sierra_2: Setting Powered False 10:13:23.338543 run create_hlr_db(pid=6526): Terminated: ok {rc=0} 10:13:23.794616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6528): Launched 10:13:24.123432 run osmo-hlr_10.42.42.2(pid=6529): Launched 10:13:24.247463 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:24.814014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6531): Launched 10:13:25.142248 run osmo-stp_10.42.42.5(pid=6532): Launched 10:13:25.266445 run osmo-msc_10.42.42.6: Starting osmo-msc 10:13:25.855025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6534): Launched 10:13:26.181780 run osmo-msc_10.42.42.6(pid=6535): Launched 10:13:26.364491 run osmo-stp_10.42.42.5(pid=6532): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6532)] 10:13:26.500936 run osmo-stp_10.42.42.5(pid=6532): stdout: | (launched: 2022-12-14_10:13:25.081907) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:26.638587 run osmo-stp_10.42.42.5(pid=6532): stderr: | 20221214101325274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101325275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101325275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101325275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101325276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101325276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101325276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:26.775091 run osmo-stp_10.42.42.5(pid=6532): stdout: | (launched: 2022-12-14_10:13:25.081907) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:26.904157 run osmo-stp_10.42.42.5(pid=6532): stderr: | 20221214101325274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101325275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101325275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101325275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101325276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101325276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101325276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:27.059249 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6532): Process ended prematurely: osmo-stp_10.42.42.5(pid=6532) [trial-2403↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6532)] [trial-2403↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:13:27.068783 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:13:27.096844 run osmo-hlr_10.42.42.2(pid=6529): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6529)] 10:13:27.147491 run osmo-hlr_10.42.42.2(pid=6529): stdout: | (launched: 2022-12-14_10:13:24.063574) 10:13:27.199800 run osmo-hlr_10.42.42.2(pid=6529): stderr: | 20221214101324261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101324261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101324261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101324261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101324261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101324261 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101324274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101324282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101324282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101324283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:27.273293 run osmo-msc_10.42.42.6(pid=6535): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6535)] 10:13:27.323553 run osmo-msc_10.42.42.6(pid=6535): stdout: | (launched: 2022-12-14_10:13:26.122037) 10:13:27.375825 run osmo-msc_10.42.42.6(pid=6535): stderr: | 20221214101326446 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101326446 DLGLOBAL DEBUG validating counter group 0x7f3b37f78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101326446 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101326446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101326446 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101326447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101326448 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101326449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101326449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101326449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:13:27.428463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6528): Terminating (SIGTERM) 10:13:27.470544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6531): Terminating (SIGTERM) 10:13:27.513279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6534): Terminating (SIGTERM) 10:13:27.555346 --- ParallelTerminationStrategy: PID 6528 died... 10:13:27.575486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6528): Terminated: ok {rc=0} 10:13:27.621969 --- ParallelTerminationStrategy: PID 6531 died... 10:13:27.641661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6531): Terminated: ok {rc=0} 10:13:27.687934 --- ParallelTerminationStrategy: PID 6534 died... 10:13:27.707606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6534): Terminated: ok {rc=0} 10:13:27.796093 bus /sierra_3: Setting Powered False 10:13:28.894505 bus /sierra_3: Setting Powered False 10:13:30.010698 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:13:31.292445 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:13:31.301965 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:13:31.349552 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:13:31.382338 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:13:31.437141 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:13:31.482160 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:13:31.518699 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:13:32.071224 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:13:32.132460 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:13:32.144381 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:13:32.218642 tst mo_mt_call.py: using LAC 40218 10:13:32.350270 tst mo_mt_call.py: using RAC 183 10:13:32.472493 tst mo_mt_call.py: using CellId 40218 10:13:32.593963 tst mo_mt_call.py: using BVCI 40219 10:13:32.704407 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:13:32.715287 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:13:32.726676 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:13:32.737548 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:13:32.748630 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:13:32.759628 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:13:32.879516 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:13:32.996768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:33.470635 run create_hlr_db(pid=6540): Launched 10:13:33.588109 bus /sierra_2: Setting Powered False 10:13:34.647178 run create_hlr_db(pid=6540): Terminated: ok {rc=0} 10:13:35.095619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6542): Launched 10:13:35.422848 run osmo-hlr_10.42.42.2(pid=6543): Launched 10:13:35.549639 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:36.115745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6545): Launched 10:13:36.442397 run osmo-stp_10.42.42.5(pid=6546): Launched 10:13:36.569217 run osmo-msc_10.42.42.6: Starting osmo-msc 10:13:37.157126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6548): Launched 10:13:37.485060 run osmo-msc_10.42.42.6(pid=6549): Launched 10:13:37.667708 run osmo-stp_10.42.42.5(pid=6546): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6546)] 10:13:37.804625 run osmo-stp_10.42.42.5(pid=6546): stdout: | (launched: 2022-12-14_10:13:36.382718) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:37.942658 run osmo-stp_10.42.42.5(pid=6546): stderr: | 20221214101336575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101336575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101336576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101336576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101336576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101336576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101336577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:38.080022 run osmo-stp_10.42.42.5(pid=6546): stdout: | (launched: 2022-12-14_10:13:36.382718) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:38.209120 run osmo-stp_10.42.42.5(pid=6546): stderr: | 20221214101336575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101336575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101336576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101336576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101336576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101336576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101336577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:38.364383 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6546): Process ended prematurely: osmo-stp_10.42.42.5(pid=6546) [trial-2403↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6546)] [trial-2403↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:13:38.374228 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:13:38.402384 run osmo-hlr_10.42.42.2(pid=6543): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6543)] 10:13:38.453452 run osmo-hlr_10.42.42.2(pid=6543): stdout: | (launched: 2022-12-14_10:13:35.363533) 10:13:38.506043 run osmo-hlr_10.42.42.2(pid=6543): stderr: | 20221214101335561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101335561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101335561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101335561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101335561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101335562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101335574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101335585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101335585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101335585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:38.579380 run osmo-msc_10.42.42.6(pid=6549): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6549)] 10:13:38.629970 run osmo-msc_10.42.42.6(pid=6549): stdout: | (launched: 2022-12-14_10:13:37.425373) 10:13:38.682527 run osmo-msc_10.42.42.6(pid=6549): stderr: | 20221214101337748 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101337748 DLGLOBAL DEBUG validating counter group 0x7fe7d8fbfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101337748 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101337748 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101337748 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101337748 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101337750 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101337751 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101337751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101337751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:13:38.735311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6542): Terminating (SIGTERM) 10:13:38.777603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6545): Terminating (SIGTERM) 10:13:38.819637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6548): Terminating (SIGTERM) 10:13:38.861789 --- ParallelTerminationStrategy: PID 6542 died... 10:13:38.881947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6542): Terminated: ok {rc=0} 10:13:38.928704 --- ParallelTerminationStrategy: PID 6545 died... 10:13:38.948565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6545): Terminated: ok {rc=0} 10:13:38.995042 --- ParallelTerminationStrategy: PID 6548 died... 10:13:39.014917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6548): Terminated: ok {rc=0} 10:13:39.102580 bus /sierra_3: Setting Powered False 10:13:40.202706 bus /sierra_3: Setting Powered False 10:13:41.319843 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:13:42.470576 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:13:42.482694 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:13:42.556504 tst mo_mt_call_osmux.py: using LAC 40219 10:13:42.685932 tst mo_mt_call_osmux.py: using RAC 184 10:13:42.814574 tst mo_mt_call_osmux.py: using CellId 40219 10:13:42.943619 tst mo_mt_call_osmux.py: using BVCI 40220 10:13:43.061418 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:13:43.072637 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:13:43.083765 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:13:43.094978 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:13:43.106224 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:13:43.117469 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:13:43.238417 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:13:43.356332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:43.831700 run create_hlr_db(pid=6551): Launched 10:13:43.949704 bus /sierra_2: Setting Powered False 10:13:45.010378 run create_hlr_db(pid=6551): Terminated: ok {rc=0} 10:13:45.437663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6553): Launched 10:13:45.743917 run osmo-hlr_10.42.42.2(pid=6554): Launched 10:13:45.867358 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:46.543216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6556): Launched 10:13:46.903597 run osmo-stp_10.42.42.5(pid=6557): Launched 10:13:47.215289 run osmo-msc_10.42.42.6: Starting osmo-msc 10:13:47.810540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6559): Launched 10:13:48.138640 run osmo-msc_10.42.42.6(pid=6560): Launched 10:13:48.322426 run osmo-stp_10.42.42.5(pid=6557): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6557)] 10:13:48.459116 run osmo-stp_10.42.42.5(pid=6557): stdout: | (launched: 2022-12-14_10:13:46.846034) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:48.596568 run osmo-stp_10.42.42.5(pid=6557): stderr: | 20221214101347057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101347057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101347057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101347058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101347058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101347058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101347058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:48.733243 run osmo-stp_10.42.42.5(pid=6557): stdout: | (launched: 2022-12-14_10:13:46.846034) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:48.862617 run osmo-stp_10.42.42.5(pid=6557): stderr: | 20221214101347057 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101347057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101347057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101347058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101347058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101347058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101347058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:49.017562 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6557): Process ended prematurely: osmo-stp_10.42.42.5(pid=6557) [trial-2403↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6557)] [trial-2403↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:13:49.027243 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:13:49.055443 run osmo-hlr_10.42.42.2(pid=6554): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6554)] 10:13:49.105801 run osmo-hlr_10.42.42.2(pid=6554): stdout: | (launched: 2022-12-14_10:13:45.687740) 10:13:49.158186 run osmo-hlr_10.42.42.2(pid=6554): stderr: | 20221214101345946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101345946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101345946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101345946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101345946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101345946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101345963 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101345980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101345989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101345989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:49.231482 run osmo-msc_10.42.42.6(pid=6560): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6560)] 10:13:49.281923 run osmo-msc_10.42.42.6(pid=6560): stdout: | (launched: 2022-12-14_10:13:48.078085) 10:13:49.334179 run osmo-msc_10.42.42.6(pid=6560): stderr: | 20221214101348400 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101348400 DLGLOBAL DEBUG validating counter group 0x7fe2047bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101348400 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101348400 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101348401 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101348401 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101348402 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101348403 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101348403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101348403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:13:49.386831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6553): Terminating (SIGTERM) 10:13:49.429142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6556): Terminating (SIGTERM) 10:13:49.471323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6559): Terminating (SIGTERM) 10:13:49.513937 --- ParallelTerminationStrategy: PID 6553 died... 10:13:49.534319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6553): Terminated: ok {rc=0} 10:13:49.580893 --- ParallelTerminationStrategy: PID 6556 died... 10:13:49.600623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6556): Terminated: ok {rc=0} 10:13:49.646696 --- ParallelTerminationStrategy: PID 6559 died... 10:13:49.666378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6559): Terminated: ok {rc=0} 10:13:49.754469 bus /sierra_3: Setting Powered False 10:13:50.853108 bus /sierra_3: Setting Powered False 10:13:51.969134 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 10:13:53.220896 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:13:53.225958 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 10:13:53.258447 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 10:13:53.285621 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 10:13:53.336697 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 10:13:53.369374 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 10:13:53.395900 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 10:13:53.945659 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 10:13:54.000021 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:13:54.011569 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 10:13:54.064519 tst mo_mt_call.py: using LAC 40220 10:13:54.194479 tst mo_mt_call.py: using RAC 185 10:13:54.322837 tst mo_mt_call.py: using CellId 40220 10:13:54.452468 tst mo_mt_call.py: using BVCI 40221 10:13:54.571636 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:13:54.583264 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:13:54.594451 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:13:54.606090 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:13:54.617299 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:13:54.628533 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:13:54.747687 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:13:54.866555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:55.340691 run create_hlr_db(pid=6566): Launched 10:13:55.459138 bus /sierra_2: Setting Powered False 10:13:56.519764 run create_hlr_db(pid=6566): Terminated: ok {rc=0} 10:13:56.967766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6568): Launched 10:13:57.295753 run osmo-hlr_10.42.42.2(pid=6569): Launched 10:13:57.419811 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:57.980368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6571): Launched 10:13:58.308705 run osmo-stp_10.42.42.5(pid=6572): Launched 10:13:58.432624 run osmo-msc_10.42.42.6: Starting osmo-msc 10:13:59.020543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6574): Launched 10:13:59.347869 run osmo-msc_10.42.42.6(pid=6575): Launched 10:13:59.528316 run osmo-stp_10.42.42.5(pid=6572): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6572)] 10:13:59.665776 run osmo-stp_10.42.42.5(pid=6572): stdout: | (launched: 2022-12-14_10:13:58.249276) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:59.804229 run osmo-stp_10.42.42.5(pid=6572): stderr: | 20221214101358443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101358444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101358444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101358444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101358445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101358445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101358445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:59.940654 run osmo-stp_10.42.42.5(pid=6572): stdout: | (launched: 2022-12-14_10:13:58.249276) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:00.070761 run osmo-stp_10.42.42.5(pid=6572): stderr: | 20221214101358443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101358444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101358444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101358444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101358445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101358445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101358445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:00.226011 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6572): Process ended prematurely: osmo-stp_10.42.42.5(pid=6572) [trial-2403↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6572)] [trial-2403↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 10:14:00.235788 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:14:00.264266 run osmo-hlr_10.42.42.2(pid=6569): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6569)] 10:14:00.314931 run osmo-hlr_10.42.42.2(pid=6569): stdout: | (launched: 2022-12-14_10:13:57.236250) 10:14:00.367515 run osmo-hlr_10.42.42.2(pid=6569): stderr: | 20221214101357434 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101357434 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101357434 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101357434 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101357434 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101357434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101357451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101357459 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101357459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101357459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:00.440559 run osmo-msc_10.42.42.6(pid=6575): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6575)] 10:14:00.491014 run osmo-msc_10.42.42.6(pid=6575): stdout: | (launched: 2022-12-14_10:13:59.287710) 10:14:00.543434 run osmo-msc_10.42.42.6(pid=6575): stderr: | 20221214101359610 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101359610 DLGLOBAL DEBUG validating counter group 0x7f868b9b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101359610 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101359610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101359610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101359610 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101359612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101359612 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101359612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101359613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:14:00.596171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6568): Terminating (SIGTERM) 10:14:00.638410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6571): Terminating (SIGTERM) 10:14:00.680815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6574): Terminating (SIGTERM) 10:14:00.723251 --- ParallelTerminationStrategy: PID 6568 died... 10:14:00.743513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6568): Terminated: ok {rc=0} 10:14:00.790177 --- ParallelTerminationStrategy: PID 6571 died... 10:14:00.809841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6571): Terminated: ok {rc=0} 10:14:00.857332 --- ParallelTerminationStrategy: PID 6574 died... 10:14:00.879249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6574): Terminated: ok {rc=0} 10:14:00.979579 bus /sierra_3: Setting Powered False 10:14:02.077272 bus /sierra_3: Setting Powered False 10:14:03.198300 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 10:14:04.347577 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:14:04.359235 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 10:14:04.410694 tst mo_mt_call_osmux.py: using LAC 40221 10:14:04.532429 tst mo_mt_call_osmux.py: using RAC 186 10:14:04.654865 tst mo_mt_call_osmux.py: using CellId 40221 10:14:04.777350 tst mo_mt_call_osmux.py: using BVCI 40222 10:14:04.890733 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:14:04.901868 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:14:04.912474 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:14:04.923183 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:14:04.934304 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:14:04.945396 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:14:05.062885 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:14:05.186346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:05.692899 run create_hlr_db(pid=6577): Launched 10:14:05.826692 bus /sierra_2: Setting Powered False 10:14:06.891404 run create_hlr_db(pid=6577): Terminated: ok {rc=0} 10:14:07.329334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6579): Launched 10:14:07.637262 run osmo-hlr_10.42.42.2(pid=6580): Launched 10:14:07.754019 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:08.295983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6582): Launched 10:14:08.603417 run osmo-stp_10.42.42.5(pid=6583): Launched 10:14:08.720711 run osmo-msc_10.42.42.6: Starting osmo-msc 10:14:09.274411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6585): Launched 10:14:09.580294 run osmo-msc_10.42.42.6(pid=6586): Launched 10:14:09.752457 run osmo-stp_10.42.42.5(pid=6583): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6583)] 10:14:09.883079 run osmo-stp_10.42.42.5(pid=6583): stdout: | (launched: 2022-12-14_10:14:08.547190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:10.012927 run osmo-stp_10.42.42.5(pid=6583): stderr: | 20221214101408716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101408716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101408717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101408717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101408718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101408718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101408718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:10.141528 run osmo-stp_10.42.42.5(pid=6583): stdout: | (launched: 2022-12-14_10:14:08.547190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:10.263433 run osmo-stp_10.42.42.5(pid=6583): stderr: | 20221214101408716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101408716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101408717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101408717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101408718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101408718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101408718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:10.409061 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6583): Process ended prematurely: osmo-stp_10.42.42.5(pid=6583) [trial-2403↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6583)] [trial-2403↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 10:14:10.418038 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:14:10.444397 run osmo-hlr_10.42.42.2(pid=6580): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6580)] 10:14:10.493343 run osmo-hlr_10.42.42.2(pid=6580): stdout: | (launched: 2022-12-14_10:14:07.580738) 10:14:10.543083 run osmo-hlr_10.42.42.2(pid=6580): stderr: | 20221214101407757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101407757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101407757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101407757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101407757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101407757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101407772 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101407781 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101407781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101407781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:10.612817 run osmo-msc_10.42.42.6(pid=6586): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6586)] 10:14:10.660575 run osmo-msc_10.42.42.6(pid=6586): stdout: | (launched: 2022-12-14_10:14:09.523887) 10:14:10.710524 run osmo-msc_10.42.42.6(pid=6586): stderr: | 20221214101409795 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101409795 DLGLOBAL DEBUG validating counter group 0x7f7f8d497c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101409795 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101409796 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101409796 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101409796 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101409798 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101409798 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101409798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101409798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:14:10.760608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6579): Terminating (SIGTERM) 10:14:10.800656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6582): Terminating (SIGTERM) 10:14:10.840527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6585): Terminating (SIGTERM) 10:14:10.880885 --- ParallelTerminationStrategy: PID 6579 died... 10:14:10.900518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6579): Terminated: ok {rc=0} 10:14:10.945026 --- ParallelTerminationStrategy: PID 6582 died... 10:14:10.964006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6582): Terminated: ok {rc=0} 10:14:11.008149 --- ParallelTerminationStrategy: PID 6585 died... 10:14:11.027101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6585): Terminated: ok {rc=0} 10:14:11.114026 bus /sierra_3: Setting Powered False 10:14:12.215869 bus /sierra_3: Setting Powered False 10:14:13.333355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:14:14.586502 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:14:14.593688 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:14:14.626756 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 10:14:14.654019 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 10:14:14.707256 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:14:14.741108 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 10:14:14.767702 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 10:14:15.317233 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 10:14:15.370799 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:14:15.382794 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:14:15.437407 tst mo_mt_call.py: using LAC 40222 10:14:15.565095 tst mo_mt_call.py: using RAC 187 10:14:15.693487 tst mo_mt_call.py: using CellId 40222 10:14:15.820877 tst mo_mt_call.py: using BVCI 40223 10:14:15.964396 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:14:15.976795 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:14:15.990374 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:14:16.002574 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:14:16.016003 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:14:16.029161 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:14:16.157403 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:14:16.281331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:16.771786 run create_hlr_db(pid=6591): Launched 10:14:16.919337 bus /sierra_2: Setting Powered False 10:14:17.983695 run create_hlr_db(pid=6591): Terminated: ok {rc=0} 10:14:18.441992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6593): Launched 10:14:18.770567 run osmo-hlr_10.42.42.2(pid=6594): Launched 10:14:18.896319 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:19.466578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6596): Launched 10:14:19.795113 run osmo-stp_10.42.42.5(pid=6597): Launched 10:14:19.920734 run osmo-msc_10.42.42.6: Starting osmo-msc 10:14:20.513019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6599): Launched 10:14:20.841262 run osmo-msc_10.42.42.6(pid=6600): Launched 10:14:21.023986 run osmo-stp_10.42.42.5(pid=6597): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6597)] 10:14:21.160450 run osmo-stp_10.42.42.5(pid=6597): stdout: | (launched: 2022-12-14_10:14:19.735474) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:21.299044 run osmo-stp_10.42.42.5(pid=6597): stderr: | 20221214101419927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101419927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101419927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101419928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101419928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101419928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101419928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:21.436213 run osmo-stp_10.42.42.5(pid=6597): stdout: | (launched: 2022-12-14_10:14:19.735474) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:21.565920 run osmo-stp_10.42.42.5(pid=6597): stderr: | 20221214101419927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101419927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101419927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101419928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101419928 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101419928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101419928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:21.721424 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6597): Process ended prematurely: osmo-stp_10.42.42.5(pid=6597) [trial-2403↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6597)] [trial-2403↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 10:14:21.731355 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:14:21.759530 run osmo-hlr_10.42.42.2(pid=6594): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6594)] 10:14:21.810359 run osmo-hlr_10.42.42.2(pid=6594): stdout: | (launched: 2022-12-14_10:14:18.711204) 10:14:21.862848 run osmo-hlr_10.42.42.2(pid=6594): stderr: | 20221214101418907 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101418907 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101418907 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101418907 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101418907 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101418907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101418919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101418928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101418928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101418928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:21.936050 run osmo-msc_10.42.42.6(pid=6600): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6600)] 10:14:21.986698 run osmo-msc_10.42.42.6(pid=6600): stdout: | (launched: 2022-12-14_10:14:20.781517) 10:14:22.039343 run osmo-msc_10.42.42.6(pid=6600): stderr: | 20221214101421106 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101421106 DLGLOBAL DEBUG validating counter group 0x7fc5feb77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101421106 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101421106 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101421106 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101421107 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101421108 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101421109 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101421109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101421109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:14:22.091929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6593): Terminating (SIGTERM) 10:14:22.134343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6596): Terminating (SIGTERM) 10:14:22.176720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6599): Terminating (SIGTERM) 10:14:22.219532 --- ParallelTerminationStrategy: PID 6593 died... 10:14:22.240096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6593): Terminated: ok {rc=0} 10:14:22.287155 --- ParallelTerminationStrategy: PID 6596 died... 10:14:22.307014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6596): Terminated: ok {rc=0} 10:14:22.353506 --- ParallelTerminationStrategy: PID 6599 died... 10:14:22.373362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6599): Terminated: ok {rc=0} 10:14:22.461557 bus /sierra_3: Setting Powered False 10:14:23.561311 bus /sierra_3: Setting Powered False 10:14:24.678926 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 10:14:25.829771 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:14:25.842167 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:14:25.896683 tst mo_mt_call_osmux.py: using LAC 40223 10:14:26.024311 tst mo_mt_call_osmux.py: using RAC 188 10:14:26.152182 tst mo_mt_call_osmux.py: using CellId 40223 10:14:26.280175 tst mo_mt_call_osmux.py: using BVCI 40224 10:14:26.398437 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:14:26.410244 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:14:26.421842 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:14:26.433576 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:14:26.445390 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:14:26.457008 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:14:26.576269 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:14:26.701026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:27.205294 run create_hlr_db(pid=6603): Launched 10:14:27.339648 bus /sierra_2: Setting Powered False 10:14:28.404817 run create_hlr_db(pid=6603): Terminated: ok {rc=0} 10:14:28.858271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6605): Launched 10:14:29.185164 run osmo-hlr_10.42.42.2(pid=6606): Launched 10:14:29.310884 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:29.873634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6608): Launched 10:14:30.200917 run osmo-stp_10.42.42.5(pid=6609): Launched 10:14:30.327267 run osmo-msc_10.42.42.6: Starting osmo-msc 10:14:30.921815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6611): Launched 10:14:31.281788 run osmo-msc_10.42.42.6(pid=6612): Launched 10:14:31.688778 run osmo-stp_10.42.42.5(pid=6609): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6609)] 10:14:32.019644 run osmo-stp_10.42.42.5(pid=6609): stdout: | (launched: 2022-12-14_10:14:30.141505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:32.161395 run osmo-stp_10.42.42.5(pid=6609): stderr: | 20221214101430335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101430335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101430336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101430336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101430337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101430337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101430337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:32.294158 run osmo-stp_10.42.42.5(pid=6609): stdout: | (launched: 2022-12-14_10:14:30.141505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:32.418259 run osmo-stp_10.42.42.5(pid=6609): stderr: | 20221214101430335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101430335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101430336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101430336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101430337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101430337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101430337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:32.564912 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6609): Process ended prematurely: osmo-stp_10.42.42.5(pid=6609) [trial-2403↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6609)] [trial-2403↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 10:14:32.574128 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 10:14:32.600690 run osmo-hlr_10.42.42.2(pid=6606): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6606)] 10:14:32.650406 run osmo-hlr_10.42.42.2(pid=6606): stdout: | (launched: 2022-12-14_10:14:29.125649) 10:14:32.701115 run osmo-hlr_10.42.42.2(pid=6606): stderr: | 20221214101429324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101429324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101429324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101429324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101429324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101429324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101429337 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101429345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101429345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101429345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:32.772420 run osmo-msc_10.42.42.6(pid=6612): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6612)] 10:14:32.820379 run osmo-msc_10.42.42.6(pid=6612): stdout: | (launched: 2022-12-14_10:14:31.219296) 10:14:32.870852 run osmo-msc_10.42.42.6(pid=6612): stderr: | 20221214101431698 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101431698 DLGLOBAL DEBUG validating counter group 0x7f1aa3ab9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101431698 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101431698 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101431698 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101431698 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101431700 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101431700 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101431701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101431701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:14:32.921711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6605): Terminating (SIGTERM) 10:14:32.962784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6608): Terminating (SIGTERM) 10:14:33.003811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6611): Terminating (SIGTERM) 10:14:33.045009 --- ParallelTerminationStrategy: PID 6605 died... 10:14:33.065181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6605): Terminated: ok {rc=0} 10:14:33.110440 --- ParallelTerminationStrategy: PID 6608 died... 10:14:33.129563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6608): Terminated: ok {rc=0} 10:14:33.173842 --- ParallelTerminationStrategy: PID 6611 died... 10:14:33.192762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6611): Terminated: ok {rc=0} 10:14:33.280217 bus /sierra_3: Setting Powered False 10:14:34.379739 bus /sierra_3: Setting Powered False 10:14:35.494193 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 emergency:trx-b200 --------------------------------------------------------------------- 10:14:36.754959 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:14:36.759631 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 10:14:36.793617 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 10:14:36.821122 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 10:14:36.909013 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 10:14:36.942973 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 10:14:36.970330 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 10:14:37.550662 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2403 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 10:14:37.555703 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:14:37.566329 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 10:14:37.614864 tst emergency_mo_mt_call.py: using LAC 40224 10:14:37.730789 tst emergency_mo_mt_call.py: using RAC 189 10:14:37.847285 tst emergency_mo_mt_call.py: using CellId 40224 10:14:37.963751 tst emergency_mo_mt_call.py: using BVCI 40225 10:14:38.072519 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:14:38.083258 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:14:38.093771 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:14:38.104134 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:14:38.114996 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:14:38.125797 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:14:38.246262 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:14:38.362156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:38.826410 run create_hlr_db(pid=6617): Launched 10:14:38.940626 bus /sierra_2: Setting Powered False 10:14:39.999861 run create_hlr_db(pid=6617): Terminated: ok {rc=0} 10:14:40.422861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6619): Launched 10:14:40.724576 run osmo-hlr_10.42.42.2(pid=6620): Launched 10:14:40.839580 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:41.368832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6622): Launched 10:14:41.669897 run osmo-stp_10.42.42.5(pid=6623): Launched 10:14:41.793782 tst emergency_mo_mt_call.py: using MSISDN 8634 10:14:41.946478 run osmo-msc_10.42.42.6: Starting osmo-msc 10:14:42.485778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6625): Launched 10:14:42.785063 run osmo-msc_10.42.42.6(pid=6626): Launched 10:14:42.952152 run osmo-stp_10.42.42.5(pid=6623): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6623)] 10:14:43.079349 run osmo-stp_10.42.42.5(pid=6623): stdout: | (launched: 2022-12-14_10:14:41.614413) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:43.206993 run osmo-stp_10.42.42.5(pid=6623): stderr: | 20221214101441784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101441784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101441785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101441785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101441786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101441787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101441787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:43.332226 run osmo-stp_10.42.42.5(pid=6623): stdout: | (launched: 2022-12-14_10:14:41.614413) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:43.451397 run osmo-stp_10.42.42.5(pid=6623): stderr: | 20221214101441784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101441784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101441785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101441785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101441786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101441787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101441787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:43.594064 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=6623): Process ended prematurely: osmo-stp_10.42.42.5(pid=6623) [trial-2403↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6623)] [trial-2403↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 10:14:43.602408 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 10:14:43.628525 run osmo-hlr_10.42.42.2(pid=6620): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6620)] 10:14:43.677302 run osmo-hlr_10.42.42.2(pid=6620): stdout: | (launched: 2022-12-14_10:14:40.668603) 10:14:43.727232 run osmo-hlr_10.42.42.2(pid=6620): stderr: | 20221214101440844 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101440844 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101440845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101440845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101440845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101440845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101440857 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101440865 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101440865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101440865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:43.797278 run osmo-msc_10.42.42.6(pid=6626): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6626)] 10:14:43.845254 run osmo-msc_10.42.42.6(pid=6626): stdout: | (launched: 2022-12-14_10:14:42.729714) 10:14:43.895365 run osmo-msc_10.42.42.6(pid=6626): stderr: | 20221214101443005 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101443005 DLGLOBAL DEBUG validating counter group 0x7f5c020b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101443006 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101443006 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101443006 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101443006 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101443008 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101443008 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101443008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101443008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:14:43.945709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6619): Terminating (SIGTERM) 10:14:43.985872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6622): Terminating (SIGTERM) 10:14:44.025963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6625): Terminating (SIGTERM) 10:14:44.066425 --- ParallelTerminationStrategy: PID 6619 died... 10:14:44.086082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6619): Terminated: ok {rc=0} 10:14:44.130628 --- ParallelTerminationStrategy: PID 6622 died... 10:14:44.149875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6622): Terminated: ok {rc=0} 10:14:44.194072 --- ParallelTerminationStrategy: PID 6625 died... 10:14:44.213125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6625): Terminated: ok {rc=0} 10:14:44.300189 bus /sierra_3: Setting Powered False 10:14:45.401881 bus /sierra_3: Setting Powered False 10:14:46.517849 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 10:14:47.609481 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:14:47.620691 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 10:14:47.671668 tst emergency_preemptive_call.py: using LAC 40225 10:14:47.790358 tst emergency_preemptive_call.py: using RAC 190 10:14:47.909103 tst emergency_preemptive_call.py: using CellId 40225 10:14:48.030822 tst emergency_preemptive_call.py: using BVCI 40226 10:14:48.140280 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:14:48.151069 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:14:48.161557 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:14:48.171931 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:14:48.182725 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:14:48.193947 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:14:48.313944 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:14:48.431472 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:14:48.550725 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:14:48.667422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:49.134417 run create_hlr_db(pid=6628): Launched 10:14:49.251249 bus /sierra_2: Setting Powered False 10:14:50.312325 run create_hlr_db(pid=6628): Terminated: ok {rc=0} 10:14:50.753950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6630): Launched 10:14:51.076695 run osmo-hlr_10.42.42.2(pid=6631): Launched 10:14:51.198878 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:51.750572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6633): Launched 10:14:52.072657 run osmo-stp_10.42.42.5(pid=6634): Launched 10:14:52.205966 tst emergency_preemptive_call.py: using MSISDN 8635 10:14:52.371527 run osmo-msc_10.42.42.6: Starting osmo-msc 10:14:52.947532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6636): Launched 10:14:53.271162 run osmo-msc_10.42.42.6(pid=6637): Launched 10:14:53.452486 run osmo-stp_10.42.42.5(pid=6634): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6634)] 10:14:53.588455 run osmo-stp_10.42.42.5(pid=6634): stdout: | (launched: 2022-12-14_10:14:52.013811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:53.724313 run osmo-stp_10.42.42.5(pid=6634): stderr: | 20221214101452207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101452207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101452208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101452208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101452208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101452209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101452209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:53.859605 run osmo-stp_10.42.42.5(pid=6634): stdout: | (launched: 2022-12-14_10:14:52.013811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:53.987247 run osmo-stp_10.42.42.5(pid=6634): stderr: | 20221214101452207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101452207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101452208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101452208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101452208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101452209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101452209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:54.139957 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=6634): Process ended prematurely: osmo-stp_10.42.42.5(pid=6634) [trial-2403↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6634)] [trial-2403↪emergency:trx-b200↪emergency_preemptive_call.py:32] 10:14:54.149417 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 10:14:54.177555 run osmo-hlr_10.42.42.2(pid=6631): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6631)] 10:14:54.228720 run osmo-hlr_10.42.42.2(pid=6631): stdout: | (launched: 2022-12-14_10:14:51.017973) 10:14:54.282001 run osmo-hlr_10.42.42.2(pid=6631): stderr: | 20221214101451215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101451215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101451215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101451215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101451215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101451215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101451228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101451236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101451236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101451236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:54.356088 run osmo-msc_10.42.42.6(pid=6637): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6637)] 10:14:54.406995 run osmo-msc_10.42.42.6(pid=6637): stdout: | (launched: 2022-12-14_10:14:53.210577) 10:14:54.459562 run osmo-msc_10.42.42.6(pid=6637): stderr: | 20221214101453532 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214101453532 DLGLOBAL DEBUG validating counter group 0x7f3dcfa60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214101453532 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214101453532 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214101453532 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214101453533 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214101453535 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214101453536 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214101453536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214101453536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:14:54.512916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6630): Terminating (SIGTERM) 10:14:54.555386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6633): Terminating (SIGTERM) 10:14:54.598097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6636): Terminating (SIGTERM) 10:14:54.640599 --- ParallelTerminationStrategy: PID 6630 died... 10:14:54.661127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6630): Terminated: ok {rc=0} 10:14:54.707978 --- ParallelTerminationStrategy: PID 6633 died... 10:14:54.727872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6633): Terminated: ok {rc=0} 10:14:54.774395 --- ParallelTerminationStrategy: PID 6636 died... 10:14:54.794210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6636): Terminated: ok {rc=0} 10:14:54.881956 bus /sierra_9: Setting Powered False 10:14:55.979921 bus /sierra_9: Setting Powered False 10:14:57.097553 bus /sierra_8: Setting Powered False 10:14:58.196363 bus /sierra_8: Setting Powered False 10:14:59.313472 bus /sierra_3: Setting Powered False 10:15:00.411383 bus /sierra_3: Setting Powered False 10:15:01.530722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-b200 --------------------------------------------------------------------- 10:15:02.820485 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:15:02.825616 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 10:15:02.858002 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 10:15:02.896931 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 10:15:02.985900 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 10:15:03.018861 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 10:15:03.067781 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 10:15:03.648319 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 10:15:03.702015 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:03.713227 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:15:03.763737 tst cs_paging_gprs_active.py: using LAC 40226 10:15:03.891348 tst cs_paging_gprs_active.py: using RAC 191 10:15:04.012166 tst cs_paging_gprs_active.py: using CellId 40226 10:15:04.140113 tst cs_paging_gprs_active.py: using BVCI 40227 10:15:04.259771 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:04.271186 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:04.282331 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:04.293509 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:04.304591 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:04.315654 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:04.326848 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:04.337842 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:04.349158 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:15:04.467587 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:15:04.586354 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:15:04.793032 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:05.101999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6653): Launched 10:15:05.372414 run iperf3-srv_10.42.42.10(pid=6654): Launched 10:15:05.487945 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:15:05.692592 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:06.000236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6655): Launched 10:15:06.267236 run iperf3-srv_10.42.42.10(pid=6656): Launched 10:15:06.383115 tst cs_paging_gprs_active.py:38: start network... 10:15:06.588397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:07.062142 run create_hlr_db(pid=6657): Launched 10:15:07.181819 bus /sierra_2: Setting Powered False 10:15:08.245985 run create_hlr_db(pid=6657): Terminated: ok {rc=0} 10:15:08.685157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6659): Launched 10:15:08.990901 run osmo-hlr_10.42.42.2(pid=6660): Launched 10:15:09.108480 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:09.647737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6662): Launched 10:15:09.955534 run osmo-stp_10.42.42.5(pid=6663): Launched 10:15:10.073421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:10.603328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6665): Launched 10:15:10.723196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:10.983527 run patchelf(pid=6666): Launched 10:15:11.154825 run osmo-stp_10.42.42.5(pid=6663): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6663)] 10:15:11.285810 run osmo-stp_10.42.42.5(pid=6663): stdout: | (launched: 2022-12-14_10:15:09.898993) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:11.417863 run osmo-stp_10.42.42.5(pid=6663): stderr: | 20221214101510068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101510069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101510069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101510069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101510070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101510070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101510070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:11.549815 run osmo-stp_10.42.42.5(pid=6663): stdout: | (launched: 2022-12-14_10:15:09.898993) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:11.676266 run osmo-stp_10.42.42.5(pid=6663): stderr: | 20221214101510068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101510069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101510069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101510069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101510070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101510070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101510070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:11.825155 run patchelf(pid=6666): Terminating (SIGINT) 10:15:11.999467 run patchelf(pid=6666): Terminated: ok {rc=0} 10:15:12.125321 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=6663): Process ended prematurely: osmo-stp_10.42.42.5(pid=6663) [trial-2403↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6663)] [trial-2403↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 10:15:12.135200 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 10:15:12.162610 run osmo-hlr_10.42.42.2(pid=6660): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6660)] 10:15:12.211478 run osmo-hlr_10.42.42.2(pid=6660): stdout: | (launched: 2022-12-14_10:15:08.934427) 10:15:12.261774 run osmo-hlr_10.42.42.2(pid=6660): stderr: | 20221214101509111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101509111 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101509111 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101509111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101509111 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101509111 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101509123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101509132 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101509132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101509132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:12.312276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6653): Terminating (SIGTERM) 10:15:12.352736 run iperf3-srv_10.42.42.10(pid=6654): Terminating (SIGTERM) 10:15:12.393083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6655): Terminating (SIGTERM) 10:15:12.433402 run iperf3-srv_10.42.42.10(pid=6656): Terminating (SIGTERM) 10:15:12.473585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6659): Terminating (SIGTERM) 10:15:12.514694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6662): Terminating (SIGTERM) 10:15:12.555988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6665): Terminating (SIGTERM) 10:15:12.599213 --- ParallelTerminationStrategy: PID 6653 died... 10:15:12.621122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6653): Terminated: ok {rc=0} 10:15:12.669180 --- ParallelTerminationStrategy: PID 6654 died... 10:15:12.689846 run iperf3-srv_10.42.42.10(pid=6654): Terminated {rc=256} 10:15:12.736692 --- ParallelTerminationStrategy: PID 6655 died... 10:15:12.757475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=6655): Terminated: ok {rc=0} 10:15:12.804096 --- ParallelTerminationStrategy: PID 6656 died... 10:15:12.825082 run iperf3-srv_10.42.42.10(pid=6656): Terminated {rc=256} 10:15:12.871761 --- ParallelTerminationStrategy: PID 6659 died... 10:15:12.892573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6659): Terminated: ok {rc=0} 10:15:12.939346 --- ParallelTerminationStrategy: PID 6662 died... 10:15:12.960300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6662): Terminated: ok {rc=0} 10:15:13.007127 --- ParallelTerminationStrategy: PID 6665 died... 10:15:13.028455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=6665): Terminated: ok {rc=0} 10:15:13.116594 bus /gobi_0: Setting Powered False 10:15:14.221523 bus /gobi_0: Setting Powered False 10:15:15.343828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200 iperf3.py ---------------------------------------------- 10:15:16.504756 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:16.517179 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:15:16.570710 tst iperf3.py: using LAC 40227 10:15:16.744838 tst iperf3.py: using RAC 192 10:15:16.881403 tst iperf3.py: using CellId 40227 10:15:17.007469 tst iperf3.py: using BVCI 40228 10:15:17.130338 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:17.142104 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:17.153754 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:17.165138 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:17.177731 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:17.191196 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:17.203847 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:17.216027 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:17.228715 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:15:17.349487 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:15:17.557323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:17.867823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7018): Launched 10:15:18.136783 run iperf3-srv_10.42.42.10(pid=7019): Launched 10:15:18.253269 tst iperf3.py:8: start network... 10:15:18.458029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:18.931154 run create_hlr_db(pid=7020): Launched 10:15:19.050937 bus /gobi_6: Setting Powered False 10:15:20.111136 run create_hlr_db(pid=7020): Terminated: ok {rc=0} 10:15:20.560310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7022): Launched 10:15:20.890501 run osmo-hlr_10.42.42.2(pid=7023): Launched 10:15:21.016846 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:21.582193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7025): Launched 10:15:21.909956 run osmo-stp_10.42.42.5(pid=7026): Launched 10:15:22.036364 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:22.599679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7028): Launched 10:15:22.728116 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:23.006472 run patchelf(pid=7030): Launched 10:15:23.222134 run osmo-stp_10.42.42.5(pid=7026): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7026)] 10:15:23.365343 run osmo-stp_10.42.42.5(pid=7026): stdout: | (launched: 2022-12-14_10:15:21.850003) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:23.512098 run osmo-stp_10.42.42.5(pid=7026): stderr: | 20221214101522044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101522044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101522045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101522045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101522046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101522046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101522046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:23.656741 run osmo-stp_10.42.42.5(pid=7026): stdout: | (launched: 2022-12-14_10:15:21.850003) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:23.795081 run osmo-stp_10.42.42.5(pid=7026): stderr: | 20221214101522044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101522044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101522045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101522045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101522046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101522046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101522046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:23.955180 run patchelf(pid=7030): Terminating (SIGINT) 10:15:24.147575 run patchelf(pid=7030): Terminated: ok {rc=0} 10:15:24.283755 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7026): Process ended prematurely: osmo-stp_10.42.42.5(pid=7026) [trial-2403↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7026)] [trial-2403↪gprs:trx-b200↪iperf3.py:8] 10:15:24.295299 tst iperf3.py:8: Test FAILED (7.8 sec) 10:15:24.326075 run osmo-hlr_10.42.42.2(pid=7023): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7023)] 10:15:24.378806 run osmo-hlr_10.42.42.2(pid=7023): stdout: | (launched: 2022-12-14_10:15:20.830795) 10:15:24.433200 run osmo-hlr_10.42.42.2(pid=7023): stderr: | 20221214101521031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101521031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101521031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101521031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101521031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101521032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101521044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101521054 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101521054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101521054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:24.487898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7018): Terminating (SIGTERM) 10:15:24.532289 run iperf3-srv_10.42.42.10(pid=7019): Terminating (SIGTERM) 10:15:24.579675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7022): Terminating (SIGTERM) 10:15:24.624485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7025): Terminating (SIGTERM) 10:15:24.670422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7028): Terminating (SIGTERM) 10:15:24.716565 --- ParallelTerminationStrategy: PID 7018 died... 10:15:24.737858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7018): Terminated: ok {rc=0} 10:15:24.786047 --- ParallelTerminationStrategy: PID 7019 died... 10:15:24.807206 run iperf3-srv_10.42.42.10(pid=7019): Terminated {rc=256} 10:15:24.855320 --- ParallelTerminationStrategy: PID 7022 died... 10:15:24.876489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7022): Terminated: ok {rc=0} 10:15:24.924533 --- ParallelTerminationStrategy: PID 7025 died... 10:15:24.945703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7025): Terminated: ok {rc=0} 10:15:24.993852 --- ParallelTerminationStrategy: PID 7028 died... 10:15:25.015006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7028): Terminated: ok {rc=0} 10:15:25.107616 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 10:15:26.266370 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:26.279665 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:15:26.331076 tst iperf3m4.py: using LAC 40228 10:15:26.461784 tst iperf3m4.py: using RAC 193 10:15:26.595962 tst iperf3m4.py: using CellId 40228 10:15:26.726928 tst iperf3m4.py: using BVCI 40229 10:15:26.852213 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:26.864362 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:26.876384 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:26.888478 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:26.900547 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:26.912595 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:26.924876 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:26.937169 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:26.949514 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:15:27.076161 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:15:27.203754 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:15:27.327352 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:15:27.453118 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:15:27.680943 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:28.016817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7205): Launched 10:15:28.323498 run iperf3-srv_10.42.42.10(pid=7206): Launched 10:15:28.466312 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:15:28.694835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:29.035591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7208): Launched 10:15:29.316877 run iperf3-srv_10.42.42.10(pid=7209): Launched 10:15:29.432305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:15:29.637127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:29.945130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7210): Launched 10:15:30.213097 run iperf3-srv_10.42.42.10(pid=7211): Launched 10:15:30.328421 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:15:30.532498 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:15:30.853853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7212): Launched 10:15:31.185291 run iperf3-srv_10.42.42.10(pid=7213): Launched 10:15:31.333866 tst iperf3m4.py:8: start network... 10:15:31.563041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:32.140403 run create_hlr_db(pid=7214): Launched 10:15:32.284160 bus /gobi_6: Setting Powered False 10:15:33.348744 run create_hlr_db(pid=7214): Terminated: ok {rc=0} 10:15:33.790044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7216): Launched 10:15:34.100231 run osmo-hlr_10.42.42.2(pid=7217): Launched 10:15:34.218046 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:34.768704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7219): Launched 10:15:35.099183 run osmo-stp_10.42.42.5(pid=7220): Launched 10:15:35.224314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:35.788400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7222): Launched 10:15:35.916068 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:36.193673 run patchelf(pid=7223): Launched 10:15:36.378009 run osmo-stp_10.42.42.5(pid=7220): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7220)] 10:15:36.517187 run osmo-stp_10.42.42.5(pid=7220): stdout: | (launched: 2022-12-14_10:15:35.039084) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:36.658054 run osmo-stp_10.42.42.5(pid=7220): stderr: | 20221214101535229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101535229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101535230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101535230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101535231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101535231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101535231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:36.798937 run osmo-stp_10.42.42.5(pid=7220): stdout: | (launched: 2022-12-14_10:15:35.039084) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:36.933448 run osmo-stp_10.42.42.5(pid=7220): stderr: | 20221214101535229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101535229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101535230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101535230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101535231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101535231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101535231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:37.093007 run patchelf(pid=7223): Terminating (SIGINT) 10:15:37.277079 run patchelf(pid=7223): Terminated: ok {rc=0} 10:15:37.410243 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7220): Process ended prematurely: osmo-stp_10.42.42.5(pid=7220) [trial-2403↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7220)] [trial-2403↪gprs:trx-b200↪iperf3m4.py:8] 10:15:37.420534 tst iperf3m4.py:8: Test FAILED (11.2 sec) 10:15:37.449780 run osmo-hlr_10.42.42.2(pid=7217): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7217)] 10:15:37.500734 run osmo-hlr_10.42.42.2(pid=7217): stdout: | (launched: 2022-12-14_10:15:34.043486) 10:15:37.553591 run osmo-hlr_10.42.42.2(pid=7217): stderr: | 20221214101534219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101534220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101534220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101534220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101534220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101534220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101534232 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101534240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101534240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101534240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:37.606743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7205): Terminating (SIGTERM) 10:15:37.649457 run iperf3-srv_10.42.42.10(pid=7206): Terminating (SIGTERM) 10:15:37.692192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7208): Terminating (SIGTERM) 10:15:37.734983 run iperf3-srv_10.42.42.10(pid=7209): Terminating (SIGTERM) 10:15:37.777684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7210): Terminating (SIGTERM) 10:15:37.820460 run iperf3-srv_10.42.42.10(pid=7211): Terminating (SIGTERM) 10:15:37.863336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7212): Terminating (SIGTERM) 10:15:37.906143 run iperf3-srv_10.42.42.10(pid=7213): Terminating (SIGTERM) 10:15:37.948779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7216): Terminating (SIGTERM) 10:15:37.991675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7219): Terminating (SIGTERM) 10:15:38.034395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7222): Terminating (SIGTERM) 10:15:38.077428 --- ParallelTerminationStrategy: PID 7205 died... 10:15:38.098115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7205): Terminated: ok {rc=0} 10:15:38.145244 --- ParallelTerminationStrategy: PID 7206 died... 10:15:38.165397 run iperf3-srv_10.42.42.10(pid=7206): Terminated {rc=256} 10:15:38.212263 --- ParallelTerminationStrategy: PID 7208 died... 10:15:38.232392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7208): Terminated: ok {rc=0} 10:15:38.279550 --- ParallelTerminationStrategy: PID 7209 died... 10:15:38.299669 run iperf3-srv_10.42.42.10(pid=7209): Terminated {rc=256} 10:15:38.346604 --- ParallelTerminationStrategy: PID 7210 died... 10:15:38.366718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7210): Terminated: ok {rc=0} 10:15:38.413426 --- ParallelTerminationStrategy: PID 7211 died... 10:15:38.433567 run iperf3-srv_10.42.42.10(pid=7211): Terminated {rc=256} 10:15:38.480256 --- ParallelTerminationStrategy: PID 7212 died... 10:15:38.500359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7212): Terminated: ok {rc=0} 10:15:38.547070 --- ParallelTerminationStrategy: PID 7213 died... 10:15:38.567149 run iperf3-srv_10.42.42.10(pid=7213): Terminated {rc=256} 10:15:38.613819 --- ParallelTerminationStrategy: PID 7216 died... 10:15:38.634039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7216): Terminated: ok {rc=0} 10:15:38.680653 --- ParallelTerminationStrategy: PID 7219 died... 10:15:38.700833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7219): Terminated: ok {rc=0} 10:15:38.747622 --- ParallelTerminationStrategy: PID 7222 died... 10:15:38.767820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7222): Terminated: ok {rc=0} 10:15:38.857866 bus /gobi_4: Setting Powered False 10:15:39.957938 bus /gobi_4: Setting Powered False 10:15:41.076322 bus /gobi_1: Setting Powered False 10:15:42.176076 bus /gobi_1: Setting Powered False 10:15:43.292543 bus /gobi_0: Setting Powered False 10:15:44.392647 bus /gobi_0: Setting Powered False 10:15:45.505688 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200 ping.py ---------------------------------------------- 10:15:46.609846 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:46.621607 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:15:46.673407 tst ping.py: using LAC 40229 10:15:46.794483 tst ping.py: using RAC 194 10:15:46.934162 tst ping.py: using CellId 40229 10:15:47.058837 tst ping.py: using BVCI 40230 10:15:47.178828 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:47.190859 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:47.202862 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:47.214655 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:47.227285 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:47.239823 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:47.252452 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:47.264132 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:15:47.384121 tst ping.py:19: start network... 10:15:47.587287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:48.053230 run create_hlr_db(pid=7224): Launched 10:15:48.170065 bus /gobi_6: Setting Powered False 10:15:49.230616 run create_hlr_db(pid=7224): Terminated: ok {rc=0} 10:15:49.653662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7226): Launched 10:15:49.956640 run osmo-hlr_10.42.42.2(pid=7227): Launched 10:15:50.072222 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:50.610303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7229): Launched 10:15:50.911883 run osmo-stp_10.42.42.5(pid=7230): Launched 10:15:51.028024 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:51.546763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7232): Launched 10:15:51.664203 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:51.917936 run patchelf(pid=7233): Launched 10:15:52.099611 run osmo-stp_10.42.42.5(pid=7230): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7230)] 10:15:52.236250 run osmo-stp_10.42.42.5(pid=7230): stdout: | (launched: 2022-12-14_10:15:50.856229) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:52.375840 run osmo-stp_10.42.42.5(pid=7230): stderr: | 20221214101551028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101551028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101551029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101551029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101551030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101551030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101551030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:52.514688 run osmo-stp_10.42.42.5(pid=7230): stdout: | (launched: 2022-12-14_10:15:50.856229) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:52.646797 run osmo-stp_10.42.42.5(pid=7230): stderr: | 20221214101551028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101551028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101551029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101551029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101551030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101551030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101551030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:52.803082 run patchelf(pid=7233): Terminating (SIGINT) 10:15:52.984087 run patchelf(pid=7233): Terminated: ok {rc=0} 10:15:53.114132 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7230): Process ended prematurely: osmo-stp_10.42.42.5(pid=7230) [trial-2403↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7230)] [trial-2403↪gprs:trx-b200↪ping.py:22] 10:15:53.123965 tst ping.py:22: Test FAILED (6.5 sec) 10:15:53.152406 run osmo-hlr_10.42.42.2(pid=7227): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7227)] 10:15:53.203028 run osmo-hlr_10.42.42.2(pid=7227): stdout: | (launched: 2022-12-14_10:15:49.900941) 10:15:53.255192 run osmo-hlr_10.42.42.2(pid=7227): stderr: | 20221214101550079 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101550079 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101550079 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101550079 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101550079 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101550079 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101550091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101550099 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101550099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101550099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:53.308484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7226): Terminating (SIGTERM) 10:15:53.350791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7229): Terminating (SIGTERM) 10:15:53.393068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7232): Terminating (SIGTERM) 10:15:53.435882 --- ParallelTerminationStrategy: PID 7226 died... 10:15:53.456199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7226): Terminated: ok {rc=0} 10:15:53.502762 --- ParallelTerminationStrategy: PID 7229 died... 10:15:53.522570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7229): Terminated: ok {rc=0} 10:15:53.568790 --- ParallelTerminationStrategy: PID 7232 died... 10:15:53.588838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7232): Terminated: ok {rc=0} 10:15:53.676796 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 10:15:54.764084 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:54.775762 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:15:54.826627 tst ping_idle_ping.py: using LAC 40230 10:15:54.946107 tst ping_idle_ping.py: using RAC 195 10:15:55.067807 tst ping_idle_ping.py: using CellId 40230 10:15:55.186855 tst ping_idle_ping.py: using BVCI 40231 10:15:55.297748 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:55.308426 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:55.319493 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:55.330124 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:55.340879 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:55.351825 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:55.362908 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:15:55.373977 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:15:55.493992 tst ping_idle_ping.py:24: start network... 10:15:55.711173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:56.211755 run create_hlr_db(pid=7234): Launched 10:15:56.342878 bus /gobi_6: Setting Powered False 10:15:57.406589 run create_hlr_db(pid=7234): Terminated: ok {rc=0} 10:15:57.856794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7236): Launched 10:15:58.177739 run osmo-hlr_10.42.42.2(pid=7237): Launched 10:15:58.302557 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:58.858610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7239): Launched 10:15:59.183081 run osmo-stp_10.42.42.5(pid=7240): Launched 10:15:59.308874 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:59.864708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7242): Launched 10:15:59.989446 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:16:00.261890 run patchelf(pid=7243): Launched 10:16:00.442032 run osmo-stp_10.42.42.5(pid=7240): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7240)] 10:16:00.578233 run osmo-stp_10.42.42.5(pid=7240): stdout: | (launched: 2022-12-14_10:15:59.123851) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:00.716419 run osmo-stp_10.42.42.5(pid=7240): stderr: | 20221214101559315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101559315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101559315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101559316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101559316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101559316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101559316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:00.859329 run osmo-stp_10.42.42.5(pid=7240): stdout: | (launched: 2022-12-14_10:15:59.123851) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:01.009927 run osmo-stp_10.42.42.5(pid=7240): stderr: | 20221214101559315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101559315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101559315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101559316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101559316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101559316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101559316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:01.163145 run patchelf(pid=7243): Terminating (SIGINT) 10:16:01.339819 run patchelf(pid=7243): Terminated: ok {rc=0} 10:16:01.508516 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7240): Process ended prematurely: osmo-stp_10.42.42.5(pid=7240) [trial-2403↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7240)] [trial-2403↪gprs:trx-b200↪ping_idle_ping.py:27] 10:16:01.519319 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:16:01.548515 run osmo-hlr_10.42.42.2(pid=7237): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7237)] 10:16:01.601954 run osmo-hlr_10.42.42.2(pid=7237): stdout: | (launched: 2022-12-14_10:15:58.119027) 10:16:01.655749 run osmo-hlr_10.42.42.2(pid=7237): stderr: | 20221214101558315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101558315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101558316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101558316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101558316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101558316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101558329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101558338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101558339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101558339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:01.709888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7236): Terminating (SIGTERM) 10:16:01.751992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7239): Terminating (SIGTERM) 10:16:01.797656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7242): Terminating (SIGTERM) 10:16:01.842798 --- ParallelTerminationStrategy: PID 7236 died... 10:16:01.864259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7236): Terminated: ok {rc=0} 10:16:01.912612 --- ParallelTerminationStrategy: PID 7239 died... 10:16:01.933555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7239): Terminated: ok {rc=0} 10:16:01.980214 --- ParallelTerminationStrategy: PID 7242 died... 10:16:02.003060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7242): Terminated: ok {rc=0} 10:16:02.093492 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 10:16:03.401588 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:16:03.407417 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:16:03.440901 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:16:03.480361 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:16:03.567357 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:16:03.600994 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:16:03.639909 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:16:04.236571 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:16:04.289569 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:04.301027 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:16:04.351495 tst cs_paging_gprs_active.py: using LAC 40231 10:16:04.472737 tst cs_paging_gprs_active.py: using RAC 196 10:16:04.590983 tst cs_paging_gprs_active.py: using CellId 40231 10:16:04.711480 tst cs_paging_gprs_active.py: using BVCI 40232 10:16:04.824842 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:04.835762 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:04.846419 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:04.857096 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:04.867894 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:04.878911 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:04.890085 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:04.900787 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:04.911885 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:16:05.035339 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:16:05.154369 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:16:05.363332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:05.673563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7247): Launched 10:16:05.942560 run iperf3-srv_10.42.42.10(pid=7248): Launched 10:16:06.061073 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:16:06.266065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:06.574813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7249): Launched 10:16:06.844040 run iperf3-srv_10.42.42.10(pid=7250): Launched 10:16:06.959579 tst cs_paging_gprs_active.py:38: start network... 10:16:07.165259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:07.639495 run create_hlr_db(pid=7251): Launched 10:16:07.758288 bus /gobi_6: Setting Powered False 10:16:08.819618 run create_hlr_db(pid=7251): Terminated: ok {rc=0} 10:16:09.268371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7253): Launched 10:16:09.599343 run osmo-hlr_10.42.42.2(pid=7254): Launched 10:16:09.726725 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:10.288596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7256): Launched 10:16:10.616913 run osmo-stp_10.42.42.5(pid=7257): Launched 10:16:10.743133 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:16:11.308007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7259): Launched 10:16:11.434402 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:16:11.711292 run patchelf(pid=7260): Launched 10:16:11.896260 run osmo-stp_10.42.42.5(pid=7257): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7257)] 10:16:12.035632 run osmo-stp_10.42.42.5(pid=7257): stdout: | (launched: 2022-12-14_10:16:10.556826) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:12.175827 run osmo-stp_10.42.42.5(pid=7257): stderr: | 20221214101610749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101610749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101610750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101610750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101610750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101610750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101610751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:12.316534 run osmo-stp_10.42.42.5(pid=7257): stdout: | (launched: 2022-12-14_10:16:10.556826) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:12.450721 run osmo-stp_10.42.42.5(pid=7257): stderr: | 20221214101610749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101610749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101610750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101610750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101610750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101610750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101610751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:12.609596 run patchelf(pid=7260): Terminating (SIGINT) 10:16:12.793391 run patchelf(pid=7260): Terminated: ok {rc=0} 10:16:12.925452 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7257): Process ended prematurely: osmo-stp_10.42.42.5(pid=7257) [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7257)] [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:16:12.935857 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:16:12.964745 run osmo-hlr_10.42.42.2(pid=7254): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7254)] 10:16:13.015026 run osmo-hlr_10.42.42.2(pid=7254): stdout: | (launched: 2022-12-14_10:16:09.539374) 10:16:13.067057 run osmo-hlr_10.42.42.2(pid=7254): stderr: | 20221214101609737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101609737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101609737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101609737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101609737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101609737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101609749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101609758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101609758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101609758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:13.120240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7247): Terminating (SIGTERM) 10:16:13.162417 run iperf3-srv_10.42.42.10(pid=7248): Terminating (SIGTERM) 10:16:13.204853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7249): Terminating (SIGTERM) 10:16:13.246732 run iperf3-srv_10.42.42.10(pid=7250): Terminating (SIGTERM) 10:16:13.289293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7253): Terminating (SIGTERM) 10:16:13.331330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7256): Terminating (SIGTERM) 10:16:13.373653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7259): Terminating (SIGTERM) 10:16:13.415772 --- ParallelTerminationStrategy: PID 7247 died... 10:16:13.435936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7247): Terminated: ok {rc=0} 10:16:13.482375 --- ParallelTerminationStrategy: PID 7248 died... 10:16:13.501874 run iperf3-srv_10.42.42.10(pid=7248): Terminated {rc=256} 10:16:13.547830 --- ParallelTerminationStrategy: PID 7249 died... 10:16:13.567380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7249): Terminated: ok {rc=0} 10:16:13.613434 --- ParallelTerminationStrategy: PID 7250 died... 10:16:13.632875 run iperf3-srv_10.42.42.10(pid=7250): Terminated {rc=256} 10:16:13.678916 --- ParallelTerminationStrategy: PID 7253 died... 10:16:13.698445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7253): Terminated: ok {rc=0} 10:16:13.744753 --- ParallelTerminationStrategy: PID 7256 died... 10:16:13.764333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7256): Terminated: ok {rc=0} 10:16:13.810468 --- ParallelTerminationStrategy: PID 7259 died... 10:16:13.830059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7259): Terminated: ok {rc=0} 10:16:13.918283 bus /gobi_0: Setting Powered False 10:16:15.018051 bus /gobi_0: Setting Powered False 10:16:16.136002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:16:17.289529 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:17.301894 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:16:17.359800 tst iperf3.py: using LAC 40232 10:16:17.487168 tst iperf3.py: using RAC 197 10:16:17.613516 tst iperf3.py: using CellId 40232 10:16:17.735397 tst iperf3.py: using BVCI 40233 10:16:17.846906 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:17.857880 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:17.868642 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:17.879475 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:17.890767 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:17.902092 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:17.913698 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:17.924912 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:17.937112 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:16:18.055255 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:16:18.262193 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:18.571786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7261): Launched 10:16:18.840927 run iperf3-srv_10.42.42.10(pid=7262): Launched 10:16:18.956688 tst iperf3.py:8: start network... 10:16:19.163258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:19.638557 run create_hlr_db(pid=7263): Launched 10:16:19.758110 bus /gobi_6: Setting Powered False 10:16:20.819202 run create_hlr_db(pid=7263): Terminated: ok {rc=0} 10:16:21.251606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7265): Launched 10:16:21.558893 run osmo-hlr_10.42.42.2(pid=7266): Launched 10:16:21.677959 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:22.209940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7268): Launched 10:16:22.517029 run osmo-stp_10.42.42.5(pid=7269): Launched 10:16:22.634515 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:16:23.162505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7271): Launched 10:16:23.283530 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:16:23.542952 run patchelf(pid=7272): Launched 10:16:23.714660 run osmo-stp_10.42.42.5(pid=7269): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7269)] 10:16:23.844682 run osmo-stp_10.42.42.5(pid=7269): stdout: | (launched: 2022-12-14_10:16:22.460543) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:23.976411 run osmo-stp_10.42.42.5(pid=7269): stderr: | 20221214101622631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101622632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101622632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101622632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101622633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101622633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101622633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:24.108491 run osmo-stp_10.42.42.5(pid=7269): stdout: | (launched: 2022-12-14_10:16:22.460543) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:24.234562 run osmo-stp_10.42.42.5(pid=7269): stderr: | 20221214101622631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101622632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101622632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101622632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101622633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101622633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101622633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:24.384064 run patchelf(pid=7272): Terminating (SIGINT) 10:16:24.556851 run patchelf(pid=7272): Terminated: ok {rc=0} 10:16:24.681713 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7269): Process ended prematurely: osmo-stp_10.42.42.5(pid=7269) [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7269)] [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 10:16:24.691300 tst iperf3.py:8: Test FAILED (7.4 sec) 10:16:24.718606 run osmo-hlr_10.42.42.2(pid=7266): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7266)] 10:16:24.766964 run osmo-hlr_10.42.42.2(pid=7266): stdout: | (launched: 2022-12-14_10:16:21.502216) 10:16:24.817244 run osmo-hlr_10.42.42.2(pid=7266): stderr: | 20221214101621678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101621678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101621678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101621678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101621678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101621678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101621690 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101621698 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101621698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101621698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:24.867910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7261): Terminating (SIGTERM) 10:16:24.908082 run iperf3-srv_10.42.42.10(pid=7262): Terminating (SIGTERM) 10:16:24.948359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7265): Terminating (SIGTERM) 10:16:24.988614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7268): Terminating (SIGTERM) 10:16:25.029124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7271): Terminating (SIGTERM) 10:16:25.070104 --- ParallelTerminationStrategy: PID 7261 died... 10:16:25.089683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7261): Terminated: ok {rc=0} 10:16:25.134244 --- ParallelTerminationStrategy: PID 7262 died... 10:16:25.153056 run iperf3-srv_10.42.42.10(pid=7262): Terminated {rc=256} 10:16:25.197665 --- ParallelTerminationStrategy: PID 7265 died... 10:16:25.216792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7265): Terminated: ok {rc=0} 10:16:25.260739 --- ParallelTerminationStrategy: PID 7268 died... 10:16:25.279696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7268): Terminated: ok {rc=0} 10:16:25.323800 --- ParallelTerminationStrategy: PID 7271 died... 10:16:25.342910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7271): Terminated: ok {rc=0} 10:16:25.429504 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:16:26.578593 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:26.590566 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:16:26.641325 tst iperf3m4.py: using LAC 40233 10:16:26.762607 tst iperf3m4.py: using RAC 198 10:16:26.884582 tst iperf3m4.py: using CellId 40233 10:16:27.006803 tst iperf3m4.py: using BVCI 40234 10:16:27.120263 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:27.131385 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:27.142346 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:27.153087 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:27.164110 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:27.174964 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:27.186475 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:27.197773 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:27.209244 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:16:27.331207 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:16:27.452516 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:16:27.573527 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:16:27.695347 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:16:27.902725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:28.212798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7273): Launched 10:16:28.482444 run iperf3-srv_10.42.42.10(pid=7274): Launched 10:16:28.600027 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:16:28.804374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:29.112706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7275): Launched 10:16:29.382438 run iperf3-srv_10.42.42.10(pid=7276): Launched 10:16:29.499758 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:16:29.704397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:30.012288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7277): Launched 10:16:30.282614 run iperf3-srv_10.42.42.10(pid=7278): Launched 10:16:30.400224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:16:30.604615 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:16:30.933641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7279): Launched 10:16:31.216509 run iperf3-srv_10.42.42.10(pid=7280): Launched 10:16:31.350575 tst iperf3m4.py:8: start network... 10:16:31.559891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:32.043365 run create_hlr_db(pid=7281): Launched 10:16:32.196562 bus /gobi_6: Setting Powered False 10:16:33.258549 run create_hlr_db(pid=7281): Terminated: ok {rc=0} 10:16:33.709633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7283): Launched 10:16:34.040360 run osmo-hlr_10.42.42.2(pid=7284): Launched 10:16:34.164826 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:34.735467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7286): Launched 10:16:35.065035 run osmo-stp_10.42.42.5(pid=7287): Launched 10:16:35.190754 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:16:35.755658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7289): Launched 10:16:35.883757 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:16:36.161379 run patchelf(pid=7290): Launched 10:16:36.345505 run osmo-stp_10.42.42.5(pid=7287): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7287)] 10:16:36.484496 run osmo-stp_10.42.42.5(pid=7287): stdout: | (launched: 2022-12-14_10:16:35.004529) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:36.625194 run osmo-stp_10.42.42.5(pid=7287): stderr: | 20221214101635197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101635197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101635197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101635198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101635198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101635198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101635198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:36.765817 run osmo-stp_10.42.42.5(pid=7287): stdout: | (launched: 2022-12-14_10:16:35.004529) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:36.900024 run osmo-stp_10.42.42.5(pid=7287): stderr: | 20221214101635197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101635197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101635197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101635198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101635198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101635198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101635198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:37.059892 run patchelf(pid=7290): Terminating (SIGINT) 10:16:37.244718 run patchelf(pid=7290): Terminated: ok {rc=0} 10:16:37.379677 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7287): Process ended prematurely: osmo-stp_10.42.42.5(pid=7287) [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7287)] [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 10:16:37.390284 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:16:37.419694 run osmo-hlr_10.42.42.2(pid=7284): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7284)] 10:16:37.470576 run osmo-hlr_10.42.42.2(pid=7284): stdout: | (launched: 2022-12-14_10:16:33.979931) 10:16:37.523586 run osmo-hlr_10.42.42.2(pid=7284): stderr: | 20221214101634175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101634175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101634175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101634176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101634176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101634176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101634188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101634199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101634199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101634199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:37.576384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7273): Terminating (SIGTERM) 10:16:37.618829 run iperf3-srv_10.42.42.10(pid=7274): Terminating (SIGTERM) 10:16:37.661525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7275): Terminating (SIGTERM) 10:16:37.704074 run iperf3-srv_10.42.42.10(pid=7276): Terminating (SIGTERM) 10:16:37.746216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7277): Terminating (SIGTERM) 10:16:37.788470 run iperf3-srv_10.42.42.10(pid=7278): Terminating (SIGTERM) 10:16:37.830563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7279): Terminating (SIGTERM) 10:16:37.873275 run iperf3-srv_10.42.42.10(pid=7280): Terminating (SIGTERM) 10:16:37.915230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7283): Terminating (SIGTERM) 10:16:37.957571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7286): Terminating (SIGTERM) 10:16:37.999662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7289): Terminating (SIGTERM) 10:16:38.042138 --- ParallelTerminationStrategy: PID 7273 died... 10:16:38.062578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7273): Terminated: ok {rc=0} 10:16:38.109278 --- ParallelTerminationStrategy: PID 7274 died... 10:16:38.129015 run iperf3-srv_10.42.42.10(pid=7274): Terminated {rc=256} 10:16:38.175055 --- ParallelTerminationStrategy: PID 7275 died... 10:16:38.194800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7275): Terminated: ok {rc=0} 10:16:38.241155 --- ParallelTerminationStrategy: PID 7276 died... 10:16:38.260929 run iperf3-srv_10.42.42.10(pid=7276): Terminated {rc=256} 10:16:38.307535 --- ParallelTerminationStrategy: PID 7277 died... 10:16:38.327451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7277): Terminated: ok {rc=0} 10:16:38.373893 --- ParallelTerminationStrategy: PID 7278 died... 10:16:38.393668 run iperf3-srv_10.42.42.10(pid=7278): Terminated {rc=256} 10:16:38.439964 --- ParallelTerminationStrategy: PID 7279 died... 10:16:38.459717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7279): Terminated: ok {rc=0} 10:16:38.506021 --- ParallelTerminationStrategy: PID 7280 died... 10:16:38.525960 run iperf3-srv_10.42.42.10(pid=7280): Terminated {rc=256} 10:16:38.572109 --- ParallelTerminationStrategy: PID 7283 died... 10:16:38.592016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7283): Terminated: ok {rc=0} 10:16:38.638283 --- ParallelTerminationStrategy: PID 7286 died... 10:16:38.658086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7286): Terminated: ok {rc=0} 10:16:38.704408 --- ParallelTerminationStrategy: PID 7289 died... 10:16:38.724294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7289): Terminated: ok {rc=0} 10:16:38.812073 bus /gobi_4: Setting Powered False 10:16:39.913212 bus /gobi_4: Setting Powered False 10:16:41.032307 bus /gobi_1: Setting Powered False 10:16:42.133310 bus /gobi_1: Setting Powered False 10:16:43.248734 bus /gobi_0: Setting Powered False 10:16:44.346964 bus /gobi_0: Setting Powered False 10:16:45.464411 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 10:16:46.583911 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:46.602276 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:16:46.662312 tst ping.py: using LAC 40234 10:16:46.790326 tst ping.py: using RAC 199 10:16:46.951272 tst ping.py: using CellId 40234 10:16:47.073450 tst ping.py: using BVCI 40235 10:16:47.193766 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:47.205647 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:47.217242 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:47.228844 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:47.240460 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:47.252094 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:47.264112 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:47.275773 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:16:47.394183 tst ping.py:19: start network... 10:16:47.596159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:48.061400 run create_hlr_db(pid=7291): Launched 10:16:48.177830 bus /gobi_6: Setting Powered False 10:16:49.239858 run create_hlr_db(pid=7291): Terminated: ok {rc=0} 10:16:49.682735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7293): Launched 10:16:50.007335 run osmo-hlr_10.42.42.2(pid=7294): Launched 10:16:50.129392 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:50.686228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7296): Launched 10:16:51.007808 run osmo-stp_10.42.42.5(pid=7297): Launched 10:16:51.131738 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:16:51.686787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7299): Launched 10:16:51.811659 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:16:52.083668 run patchelf(pid=7300): Launched 10:16:52.264046 run osmo-stp_10.42.42.5(pid=7297): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7297)] 10:16:52.401457 run osmo-stp_10.42.42.5(pid=7297): stdout: | (launched: 2022-12-14_10:16:50.948462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:52.539732 run osmo-stp_10.42.42.5(pid=7297): stderr: | 20221214101651141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101651142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101651142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101651142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101651143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101651143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101651143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:52.678105 run osmo-stp_10.42.42.5(pid=7297): stdout: | (launched: 2022-12-14_10:16:50.948462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:52.809591 run osmo-stp_10.42.42.5(pid=7297): stderr: | 20221214101651141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101651142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101651142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101651142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101651143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101651143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101651143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:52.965752 run patchelf(pid=7300): Terminating (SIGINT) 10:16:53.146241 run patchelf(pid=7300): Terminated: ok {rc=0} 10:16:53.276238 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7297): Process ended prematurely: osmo-stp_10.42.42.5(pid=7297) [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7297)] [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 10:16:53.286066 tst ping.py:22: Test FAILED (6.7 sec) 10:16:53.314850 run osmo-hlr_10.42.42.2(pid=7294): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7294)] 10:16:53.365373 run osmo-hlr_10.42.42.2(pid=7294): stdout: | (launched: 2022-12-14_10:16:49.947675) 10:16:53.418056 run osmo-hlr_10.42.42.2(pid=7294): stderr: | 20221214101650145 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101650145 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101650145 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101650145 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101650145 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101650145 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101650158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101650166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101650166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101650166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:53.471021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7293): Terminating (SIGTERM) 10:16:53.513547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7296): Terminating (SIGTERM) 10:16:53.556146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7299): Terminating (SIGTERM) 10:16:53.598755 --- ParallelTerminationStrategy: PID 7293 died... 10:16:53.619302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7293): Terminated: ok {rc=0} 10:16:53.666009 --- ParallelTerminationStrategy: PID 7296 died... 10:16:53.685912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7296): Terminated: ok {rc=0} 10:16:53.732278 --- ParallelTerminationStrategy: PID 7299 died... 10:16:53.752056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7299): Terminated: ok {rc=0} 10:16:53.840456 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:16:54.927477 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:54.939575 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:16:54.992416 tst ping_idle_ping.py: using LAC 40235 10:16:55.112752 tst ping_idle_ping.py: using RAC 200 10:16:55.232395 tst ping_idle_ping.py: using CellId 40235 10:16:55.352714 tst ping_idle_ping.py: using BVCI 40236 10:16:55.462068 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:55.473325 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:55.484067 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:55.494760 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:55.505755 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:55.516633 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:55.527769 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:16:55.538791 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:16:55.659084 tst ping_idle_ping.py:24: start network... 10:16:55.877230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:56.379197 run create_hlr_db(pid=7301): Launched 10:16:56.511012 bus /gobi_6: Setting Powered False 10:16:57.574582 run create_hlr_db(pid=7301): Terminated: ok {rc=0} 10:16:58.007938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7303): Launched 10:16:58.333741 run osmo-hlr_10.42.42.2(pid=7304): Launched 10:16:58.457379 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:59.009984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7306): Launched 10:16:59.335552 run osmo-stp_10.42.42.5(pid=7307): Launched 10:16:59.460681 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:17:00.017821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7309): Launched 10:17:00.141982 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:17:00.415636 run patchelf(pid=7310): Launched 10:17:00.597181 run osmo-stp_10.42.42.5(pid=7307): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7307)] 10:17:00.733813 run osmo-stp_10.42.42.5(pid=7307): stdout: | (launched: 2022-12-14_10:16:59.275821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:00.877107 run osmo-stp_10.42.42.5(pid=7307): stderr: | 20221214101659468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101659468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101659468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101659469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101659469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101659469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101659469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:01.022236 run osmo-stp_10.42.42.5(pid=7307): stdout: | (launched: 2022-12-14_10:16:59.275821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:01.171540 run osmo-stp_10.42.42.5(pid=7307): stderr: | 20221214101659468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101659468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101659468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101659469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101659469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101659469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101659469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:01.332299 run patchelf(pid=7310): Terminating (SIGINT) 10:17:01.534931 run patchelf(pid=7310): Terminated: ok {rc=0} 10:17:01.702118 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7307): Process ended prematurely: osmo-stp_10.42.42.5(pid=7307) [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7307)] [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 10:17:01.715597 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:17:01.752527 run osmo-hlr_10.42.42.2(pid=7304): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7304)] 10:17:01.813010 run osmo-hlr_10.42.42.2(pid=7304): stdout: | (launched: 2022-12-14_10:16:58.274112) 10:17:01.877263 run osmo-hlr_10.42.42.2(pid=7304): stderr: | 20221214101658472 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101658472 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101658472 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101658472 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101658472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101658472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101658494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101658504 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101658504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101658504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:01.942406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7303): Terminating (SIGTERM) 10:17:01.992076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7306): Terminating (SIGTERM) 10:17:02.038208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7309): Terminating (SIGTERM) 10:17:02.083146 --- ParallelTerminationStrategy: PID 7303 died... 10:17:02.104456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7303): Terminated: ok {rc=0} 10:17:02.164785 --- ParallelTerminationStrategy: PID 7306 died... 10:17:02.188535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7306): Terminated: ok {rc=0} 10:17:02.245821 --- ParallelTerminationStrategy: PID 7309 died... 10:17:02.264713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7309): Terminated: ok {rc=0} 10:17:02.354830 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:17:03.664378 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:17:03.670547 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:17:03.703419 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:17:03.743738 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:17:03.831253 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:17:03.865487 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:17:03.905108 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:17:04.501831 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:17:04.554289 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:04.565786 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:17:04.636381 tst cs_paging_gprs_active.py: using LAC 40236 10:17:04.765206 tst cs_paging_gprs_active.py: using RAC 201 10:17:04.891394 tst cs_paging_gprs_active.py: using CellId 40236 10:17:05.018168 tst cs_paging_gprs_active.py: using BVCI 40237 10:17:05.137848 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:05.149135 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:05.160188 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:05.171237 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:05.182329 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:05.193484 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:05.204605 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:05.215678 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:05.226930 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:17:05.346950 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:17:05.467443 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:17:05.689178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:17:06.017553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7317): Launched 10:17:06.304244 run iperf3-srv_10.42.42.10(pid=7318): Launched 10:17:06.428060 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:17:06.648896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:17:06.977787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7319): Launched 10:17:07.263553 run iperf3-srv_10.42.42.10(pid=7320): Launched 10:17:07.388870 tst cs_paging_gprs_active.py:38: start network... 10:17:07.610045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:08.117861 run create_hlr_db(pid=7321): Launched 10:17:08.251979 bus /gobi_6: Setting Powered False 10:17:09.316287 run create_hlr_db(pid=7321): Terminated: ok {rc=0} 10:17:09.755175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7323): Launched 10:17:10.062672 run osmo-hlr_10.42.42.2(pid=7324): Launched 10:17:10.179884 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:10.713548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7326): Launched 10:17:11.021452 run osmo-stp_10.42.42.5(pid=7327): Launched 10:17:11.138856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:17:11.670069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7329): Launched 10:17:11.790008 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:17:12.050501 run patchelf(pid=7330): Launched 10:17:12.224533 run osmo-stp_10.42.42.5(pid=7327): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7327)] 10:17:12.355505 run osmo-stp_10.42.42.5(pid=7327): stdout: | (launched: 2022-12-14_10:17:10.964676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:12.487798 run osmo-stp_10.42.42.5(pid=7327): stderr: | 20221214101711136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101711136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101711137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101711137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101711137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101711138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101711138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:12.619889 run osmo-stp_10.42.42.5(pid=7327): stdout: | (launched: 2022-12-14_10:17:10.964676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:12.746020 run osmo-stp_10.42.42.5(pid=7327): stderr: | 20221214101711136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101711136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101711137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101711137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101711137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101711138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101711138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:12.895341 run patchelf(pid=7330): Terminating (SIGINT) 10:17:13.069316 run patchelf(pid=7330): Terminated: ok {rc=0} 10:17:13.194665 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7327): Process ended prematurely: osmo-stp_10.42.42.5(pid=7327) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7327)] [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:17:13.204346 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:17:13.231505 run osmo-hlr_10.42.42.2(pid=7324): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7324)] 10:17:13.280521 run osmo-hlr_10.42.42.2(pid=7324): stdout: | (launched: 2022-12-14_10:17:10.006080) 10:17:13.330758 run osmo-hlr_10.42.42.2(pid=7324): stderr: | 20221214101710181 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101710181 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101710181 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101710182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101710182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101710182 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101710194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101710202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101710202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101710202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:13.381110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7317): Terminating (SIGTERM) 10:17:13.421320 run iperf3-srv_10.42.42.10(pid=7318): Terminating (SIGTERM) 10:17:13.461617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7319): Terminating (SIGTERM) 10:17:13.501898 run iperf3-srv_10.42.42.10(pid=7320): Terminating (SIGTERM) 10:17:13.541879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7323): Terminating (SIGTERM) 10:17:13.582215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7326): Terminating (SIGTERM) 10:17:13.622786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7329): Terminating (SIGTERM) 10:17:13.663203 --- ParallelTerminationStrategy: PID 7317 died... 10:17:13.682693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7317): Terminated: ok {rc=0} 10:17:13.727051 --- ParallelTerminationStrategy: PID 7318 died... 10:17:13.746021 run iperf3-srv_10.42.42.10(pid=7318): Terminated {rc=256} 10:17:13.790023 --- ParallelTerminationStrategy: PID 7319 died... 10:17:13.809405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7319): Terminated: ok {rc=0} 10:17:13.853716 --- ParallelTerminationStrategy: PID 7320 died... 10:17:13.872608 run iperf3-srv_10.42.42.10(pid=7320): Terminated {rc=256} 10:17:13.916341 --- ParallelTerminationStrategy: PID 7323 died... 10:17:13.935342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7323): Terminated: ok {rc=0} 10:17:13.979372 --- ParallelTerminationStrategy: PID 7326 died... 10:17:13.998498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7326): Terminated: ok {rc=0} 10:17:14.042464 --- ParallelTerminationStrategy: PID 7329 died... 10:17:14.061487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7329): Terminated: ok {rc=0} 10:17:14.148079 bus /gobi_0: Setting Powered False 10:17:15.250660 bus /gobi_0: Setting Powered False 10:17:16.368059 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:17:17.513465 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:17.524869 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:17:17.599088 tst iperf3.py: using LAC 40237 10:17:17.721361 tst iperf3.py: using RAC 202 10:17:17.844077 tst iperf3.py: using CellId 40237 10:17:17.963434 tst iperf3.py: using BVCI 40238 10:17:18.074629 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:18.085584 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:18.096277 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:18.106928 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:18.117863 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:18.128830 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:18.139887 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:18.150767 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:18.162069 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:17:18.282483 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:17:18.504313 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:17:18.833511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7331): Launched 10:17:19.119553 run iperf3-srv_10.42.42.10(pid=7332): Launched 10:17:19.244755 tst iperf3.py:8: start network... 10:17:19.466835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:19.974741 run create_hlr_db(pid=7333): Launched 10:17:20.110709 bus /gobi_6: Setting Powered False 10:17:21.175457 run create_hlr_db(pid=7333): Terminated: ok {rc=0} 10:17:21.614642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7335): Launched 10:17:21.922255 run osmo-hlr_10.42.42.2(pid=7336): Launched 10:17:22.039061 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:22.581037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7338): Launched 10:17:22.888909 run osmo-stp_10.42.42.5(pid=7339): Launched 10:17:23.008449 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:17:23.536497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7341): Launched 10:17:23.654958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:17:23.914336 run patchelf(pid=7342): Launched 10:17:24.088287 run osmo-stp_10.42.42.5(pid=7339): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7339)] 10:17:24.219209 run osmo-stp_10.42.42.5(pid=7339): stdout: | (launched: 2022-12-14_10:17:22.832384) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:24.351948 run osmo-stp_10.42.42.5(pid=7339): stderr: | 20221214101723003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101723003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101723003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101723004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101723004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101723005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101723005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:24.484080 run osmo-stp_10.42.42.5(pid=7339): stdout: | (launched: 2022-12-14_10:17:22.832384) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:24.610873 run osmo-stp_10.42.42.5(pid=7339): stderr: | 20221214101723003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101723003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101723003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101723004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101723004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101723005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101723005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:24.760156 run patchelf(pid=7342): Terminating (SIGINT) 10:17:24.932883 run patchelf(pid=7342): Terminated: ok {rc=0} 10:17:25.058034 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7339): Process ended prematurely: osmo-stp_10.42.42.5(pid=7339) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7339)] [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 10:17:25.067613 tst iperf3.py:8: Test FAILED (7.6 sec) 10:17:25.095529 run osmo-hlr_10.42.42.2(pid=7336): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7336)] 10:17:25.144440 run osmo-hlr_10.42.42.2(pid=7336): stdout: | (launched: 2022-12-14_10:17:21.865577) 10:17:25.195145 run osmo-hlr_10.42.42.2(pid=7336): stderr: | 20221214101722042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101722042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101722042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101722042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101722042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101722042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101722055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101722066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101722066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101722066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:25.245969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7331): Terminating (SIGTERM) 10:17:25.286713 run iperf3-srv_10.42.42.10(pid=7332): Terminating (SIGTERM) 10:17:25.327361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7335): Terminating (SIGTERM) 10:17:25.367955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7338): Terminating (SIGTERM) 10:17:25.408578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7341): Terminating (SIGTERM) 10:17:25.449925 --- ParallelTerminationStrategy: PID 7331 died... 10:17:25.469790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7331): Terminated: ok {rc=0} 10:17:25.514746 --- ParallelTerminationStrategy: PID 7332 died... 10:17:25.533952 run iperf3-srv_10.42.42.10(pid=7332): Terminated {rc=256} 10:17:25.578404 --- ParallelTerminationStrategy: PID 7335 died... 10:17:25.597418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7335): Terminated: ok {rc=0} 10:17:25.641827 --- ParallelTerminationStrategy: PID 7338 died... 10:17:25.660803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7338): Terminated: ok {rc=0} 10:17:25.705574 --- ParallelTerminationStrategy: PID 7341 died... 10:17:25.724868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7341): Terminated: ok {rc=0} 10:17:25.809538 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:17:26.955625 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:26.967336 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:17:27.038874 tst iperf3m4.py: using LAC 40238 10:17:27.164459 tst iperf3m4.py: using RAC 203 10:17:27.284658 tst iperf3m4.py: using CellId 40238 10:17:27.403448 tst iperf3m4.py: using BVCI 40239 10:17:27.514918 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:27.526004 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:27.536642 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:27.547438 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:27.559006 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:27.570743 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:27.582597 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:27.594132 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:27.605724 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:17:27.729089 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:17:27.848867 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:17:27.970993 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:17:28.089945 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:17:28.296906 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:17:28.608577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7343): Launched 10:17:28.879393 run iperf3-srv_10.42.42.10(pid=7344): Launched 10:17:28.997434 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:17:29.202856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:17:29.511492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7345): Launched 10:17:29.781906 run iperf3-srv_10.42.42.10(pid=7346): Launched 10:17:29.900495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:17:30.106907 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:17:30.417165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7347): Launched 10:17:30.686553 run iperf3-srv_10.42.42.10(pid=7348): Launched 10:17:30.804687 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:17:31.045649 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:17:31.369794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7349): Launched 10:17:31.644586 run iperf3-srv_10.42.42.10(pid=7350): Launched 10:17:31.773541 tst iperf3m4.py:8: start network... 10:17:31.983750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:32.466688 run create_hlr_db(pid=7351): Launched 10:17:32.586478 bus /gobi_6: Setting Powered False 10:17:33.647102 run create_hlr_db(pid=7351): Terminated: ok {rc=0} 10:17:34.098881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7353): Launched 10:17:34.428812 run osmo-hlr_10.42.42.2(pid=7354): Launched 10:17:34.555742 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:35.129137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7356): Launched 10:17:35.458943 run osmo-stp_10.42.42.5(pid=7357): Launched 10:17:35.586048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:17:36.152128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7359): Launched 10:17:36.279898 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:17:36.558875 run patchelf(pid=7360): Launched 10:17:36.744173 run osmo-stp_10.42.42.5(pid=7357): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7357)] 10:17:36.883097 run osmo-stp_10.42.42.5(pid=7357): stdout: | (launched: 2022-12-14_10:17:35.398795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:37.024099 run osmo-stp_10.42.42.5(pid=7357): stderr: | 20221214101735586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101735587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101735587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101735587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101735588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101735588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101735588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:37.164335 run osmo-stp_10.42.42.5(pid=7357): stdout: | (launched: 2022-12-14_10:17:35.398795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:37.299228 run osmo-stp_10.42.42.5(pid=7357): stderr: | 20221214101735586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101735587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101735587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101735587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101735588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101735588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101735588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:37.459010 run patchelf(pid=7360): Terminating (SIGINT) 10:17:37.644023 run patchelf(pid=7360): Terminated: ok {rc=0} 10:17:37.777988 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7357): Process ended prematurely: osmo-stp_10.42.42.5(pid=7357) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7357)] [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:17:37.788610 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:17:37.818479 run osmo-hlr_10.42.42.2(pid=7354): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7354)] 10:17:37.869305 run osmo-hlr_10.42.42.2(pid=7354): stdout: | (launched: 2022-12-14_10:17:34.368120) 10:17:37.921530 run osmo-hlr_10.42.42.2(pid=7354): stderr: | 20221214101734566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101734566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101734566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101734566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101734566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101734566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101734578 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101734587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101734587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101734587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:37.974129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7343): Terminating (SIGTERM) 10:17:38.016589 run iperf3-srv_10.42.42.10(pid=7344): Terminating (SIGTERM) 10:17:38.059112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7345): Terminating (SIGTERM) 10:17:38.101906 run iperf3-srv_10.42.42.10(pid=7346): Terminating (SIGTERM) 10:17:38.144323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7347): Terminating (SIGTERM) 10:17:38.186776 run iperf3-srv_10.42.42.10(pid=7348): Terminating (SIGTERM) 10:17:38.229110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7349): Terminating (SIGTERM) 10:17:38.271531 run iperf3-srv_10.42.42.10(pid=7350): Terminating (SIGTERM) 10:17:38.314145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7353): Terminating (SIGTERM) 10:17:38.357054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7356): Terminating (SIGTERM) 10:17:38.399610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7359): Terminating (SIGTERM) 10:17:38.442274 --- ParallelTerminationStrategy: PID 7343 died... 10:17:38.462919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7343): Terminated: ok {rc=0} 10:17:38.509850 --- ParallelTerminationStrategy: PID 7344 died... 10:17:38.529764 run iperf3-srv_10.42.42.10(pid=7344): Terminated {rc=256} 10:17:38.576181 --- ParallelTerminationStrategy: PID 7345 died... 10:17:38.596109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7345): Terminated: ok {rc=0} 10:17:38.642653 --- ParallelTerminationStrategy: PID 7346 died... 10:17:38.662575 run iperf3-srv_10.42.42.10(pid=7346): Terminated {rc=256} 10:17:38.708916 --- ParallelTerminationStrategy: PID 7347 died... 10:17:38.729048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7347): Terminated: ok {rc=0} 10:17:38.775555 --- ParallelTerminationStrategy: PID 7348 died... 10:17:38.795440 run iperf3-srv_10.42.42.10(pid=7348): Terminated {rc=256} 10:17:38.841837 --- ParallelTerminationStrategy: PID 7349 died... 10:17:38.861937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7349): Terminated: ok {rc=0} 10:17:38.908547 --- ParallelTerminationStrategy: PID 7350 died... 10:17:38.928582 run iperf3-srv_10.42.42.10(pid=7350): Terminated {rc=256} 10:17:38.975035 --- ParallelTerminationStrategy: PID 7353 died... 10:17:38.995107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7353): Terminated: ok {rc=0} 10:17:39.041542 --- ParallelTerminationStrategy: PID 7356 died... 10:17:39.061529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7356): Terminated: ok {rc=0} 10:17:39.107915 --- ParallelTerminationStrategy: PID 7359 died... 10:17:39.127991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7359): Terminated: ok {rc=0} 10:17:39.216424 bus /gobi_4: Setting Powered False 10:17:40.313322 bus /gobi_4: Setting Powered False 10:17:41.429423 bus /gobi_1: Setting Powered False 10:17:42.528408 bus /gobi_1: Setting Powered False 10:17:43.644390 bus /gobi_0: Setting Powered False 10:17:44.746139 bus /gobi_0: Setting Powered False 10:17:45.864196 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:17:46.973286 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:46.985940 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:17:47.062894 tst ping.py: using LAC 40239 10:17:47.215431 tst ping.py: using RAC 204 10:17:47.337716 tst ping.py: using CellId 40239 10:17:47.456324 tst ping.py: using BVCI 40240 10:17:47.565511 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:47.576407 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:47.587136 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:47.597941 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:47.608822 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:47.619831 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:47.631004 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:47.642045 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:17:47.757914 tst ping.py:19: start network... 10:17:47.961433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:48.429343 run create_hlr_db(pid=7361): Launched 10:17:48.546520 bus /gobi_6: Setting Powered False 10:17:49.607032 run create_hlr_db(pid=7361): Terminated: ok {rc=0} 10:17:50.051462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7363): Launched 10:17:50.376176 run osmo-hlr_10.42.42.2(pid=7364): Launched 10:17:50.501158 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:51.058959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7366): Launched 10:17:51.381663 run osmo-stp_10.42.42.5(pid=7367): Launched 10:17:51.504342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:17:52.060180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7369): Launched 10:17:52.185503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:17:52.459033 run patchelf(pid=7370): Launched 10:17:52.639518 run osmo-stp_10.42.42.5(pid=7367): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7367)] 10:17:52.775915 run osmo-stp_10.42.42.5(pid=7367): stdout: | (launched: 2022-12-14_10:17:51.322066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:52.914341 run osmo-stp_10.42.42.5(pid=7367): stderr: | 20221214101751516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101751516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101751516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101751517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101751517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101751517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101751517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:53.053237 run osmo-stp_10.42.42.5(pid=7367): stdout: | (launched: 2022-12-14_10:17:51.322066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:53.185375 run osmo-stp_10.42.42.5(pid=7367): stderr: | 20221214101751516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101751516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101751516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101751517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101751517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101751517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101751517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:53.342698 run patchelf(pid=7370): Terminating (SIGINT) 10:17:53.523778 run patchelf(pid=7370): Terminated: ok {rc=0} 10:17:53.654233 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7367): Process ended prematurely: osmo-stp_10.42.42.5(pid=7367) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7367)] [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 10:17:53.664149 tst ping.py:22: Test FAILED (6.7 sec) 10:17:53.692834 run osmo-hlr_10.42.42.2(pid=7364): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7364)] 10:17:53.743685 run osmo-hlr_10.42.42.2(pid=7364): stdout: | (launched: 2022-12-14_10:17:50.316554) 10:17:53.796413 run osmo-hlr_10.42.42.2(pid=7364): stderr: | 20221214101750517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101750517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101750517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101750517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101750517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101750517 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101750529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101750537 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101750538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101750538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:53.849666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7363): Terminating (SIGTERM) 10:17:53.892147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7366): Terminating (SIGTERM) 10:17:53.934922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7369): Terminating (SIGTERM) 10:17:53.977736 --- ParallelTerminationStrategy: PID 7363 died... 10:17:53.998403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7363): Terminated: ok {rc=0} 10:17:54.045335 --- ParallelTerminationStrategy: PID 7366 died... 10:17:54.065337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7366): Terminated: ok {rc=0} 10:17:54.111889 --- ParallelTerminationStrategy: PID 7369 died... 10:17:54.131817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7369): Terminated: ok {rc=0} 10:17:54.219336 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:17:55.308207 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:55.320201 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:17:55.394788 tst ping_idle_ping.py: using LAC 40240 10:17:55.522409 tst ping_idle_ping.py: using RAC 205 10:17:55.645387 tst ping_idle_ping.py: using CellId 40240 10:17:55.773041 tst ping_idle_ping.py: using BVCI 40241 10:17:55.892476 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:55.904101 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:55.915535 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:55.926806 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:55.938662 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:55.950477 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:55.962368 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:17:55.974093 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:17:56.092111 tst ping_idle_ping.py:24: start network... 10:17:56.296284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:56.772242 run create_hlr_db(pid=7371): Launched 10:17:56.888122 bus /gobi_6: Setting Powered False 10:17:57.948512 run create_hlr_db(pid=7371): Terminated: ok {rc=0} 10:17:58.393395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7373): Launched 10:17:58.718018 run osmo-hlr_10.42.42.2(pid=7374): Launched 10:17:58.843461 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:59.399900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7376): Launched 10:17:59.722154 run osmo-stp_10.42.42.5(pid=7377): Launched 10:17:59.846957 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:18:00.405419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7379): Launched 10:18:00.529206 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:18:00.801561 run patchelf(pid=7380): Launched 10:18:01.001543 run osmo-stp_10.42.42.5(pid=7377): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7377)] 10:18:01.144816 run osmo-stp_10.42.42.5(pid=7377): stdout: | (launched: 2022-12-14_10:17:59.663133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:01.289225 run osmo-stp_10.42.42.5(pid=7377): stderr: | 20221214101759855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101759855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101759855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101759856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101759856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101759856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101759856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:01.432200 run osmo-stp_10.42.42.5(pid=7377): stdout: | (launched: 2022-12-14_10:17:59.663133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:01.566721 run osmo-stp_10.42.42.5(pid=7377): stderr: | 20221214101759855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101759855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101759855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101759856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101759856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101759856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101759856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:01.719809 run patchelf(pid=7380): Terminating (SIGINT) 10:18:01.898357 run patchelf(pid=7380): Terminated: ok {rc=0} 10:18:02.027879 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7377): Process ended prematurely: osmo-stp_10.42.42.5(pid=7377) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7377)] [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:18:02.038410 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:18:02.067096 run osmo-hlr_10.42.42.2(pid=7374): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7374)] 10:18:02.120173 run osmo-hlr_10.42.42.2(pid=7374): stdout: | (launched: 2022-12-14_10:17:58.658515) 10:18:02.174280 run osmo-hlr_10.42.42.2(pid=7374): stderr: | 20221214101758857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101758857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101758857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101758857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101758857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101758857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101758869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101758877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101758878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101758878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:02.227163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7373): Terminating (SIGTERM) 10:18:02.267340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7376): Terminating (SIGTERM) 10:18:02.307608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7379): Terminating (SIGTERM) 10:18:02.348335 --- ParallelTerminationStrategy: PID 7373 died... 10:18:02.368135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7373): Terminated: ok {rc=0} 10:18:02.413009 --- ParallelTerminationStrategy: PID 7376 died... 10:18:02.432455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7376): Terminated: ok {rc=0} 10:18:02.476782 --- ParallelTerminationStrategy: PID 7379 died... 10:18:02.495877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7379): Terminated: ok {rc=0} 10:18:02.582750 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:18:03.894596 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:18:03.901289 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:18:03.934985 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:18:03.974129 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:18:04.063218 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:18:04.096917 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:18:04.136147 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:18:04.732834 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:18:04.785399 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:04.796654 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:18:04.868860 tst cs_paging_gprs_active.py: using LAC 40241 10:18:04.997100 tst cs_paging_gprs_active.py: using RAC 206 10:18:05.125111 tst cs_paging_gprs_active.py: using CellId 40241 10:18:05.252647 tst cs_paging_gprs_active.py: using BVCI 40242 10:18:05.364191 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:05.375049 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:05.385976 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:05.396810 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:05.407883 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:05.418928 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:05.430036 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:05.441165 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:05.452150 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:18:05.571403 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:18:05.692084 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:18:05.914457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:18:06.244733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7387): Launched 10:18:06.532826 run iperf3-srv_10.42.42.10(pid=7388): Launched 10:18:06.657452 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:18:06.878883 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:18:07.211406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7389): Launched 10:18:07.499967 run iperf3-srv_10.42.42.10(pid=7390): Launched 10:18:07.625447 tst cs_paging_gprs_active.py:38: start network... 10:18:07.846202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:08.356225 run create_hlr_db(pid=7391): Launched 10:18:08.491148 bus /gobi_6: Setting Powered False 10:18:09.555719 run create_hlr_db(pid=7391): Terminated: ok {rc=0} 10:18:09.994705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7393): Launched 10:18:10.303231 run osmo-hlr_10.42.42.2(pid=7394): Launched 10:18:10.420997 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:10.961190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7396): Launched 10:18:11.269668 run osmo-stp_10.42.42.5(pid=7397): Launched 10:18:11.387388 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:18:11.917784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7399): Launched 10:18:12.036878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:18:12.298747 run patchelf(pid=7400): Launched 10:18:12.471243 run osmo-stp_10.42.42.5(pid=7397): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7397)] 10:18:12.602835 run osmo-stp_10.42.42.5(pid=7397): stdout: | (launched: 2022-12-14_10:18:11.213236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:12.735157 run osmo-stp_10.42.42.5(pid=7397): stderr: | 20221214101811382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101811382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101811382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101811382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101811383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101811383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101811383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:12.867310 run osmo-stp_10.42.42.5(pid=7397): stdout: | (launched: 2022-12-14_10:18:11.213236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:12.994004 run osmo-stp_10.42.42.5(pid=7397): stderr: | 20221214101811382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101811382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101811382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101811382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101811383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101811383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101811383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:13.144226 run patchelf(pid=7400): Terminating (SIGINT) 10:18:13.318181 run patchelf(pid=7400): Terminated: ok {rc=0} 10:18:13.443745 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7397): Process ended prematurely: osmo-stp_10.42.42.5(pid=7397) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7397)] [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:18:13.453493 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:18:13.480760 run osmo-hlr_10.42.42.2(pid=7394): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7394)] 10:18:13.529186 run osmo-hlr_10.42.42.2(pid=7394): stdout: | (launched: 2022-12-14_10:18:10.246514) 10:18:13.578954 run osmo-hlr_10.42.42.2(pid=7394): stderr: | 20221214101810422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101810422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101810422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101810422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101810422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101810422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101810434 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101810442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101810442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101810442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:13.629168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7387): Terminating (SIGTERM) 10:18:13.669358 run iperf3-srv_10.42.42.10(pid=7388): Terminating (SIGTERM) 10:18:13.709361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7389): Terminating (SIGTERM) 10:18:13.749380 run iperf3-srv_10.42.42.10(pid=7390): Terminating (SIGTERM) 10:18:13.789300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7393): Terminating (SIGTERM) 10:18:13.829586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7396): Terminating (SIGTERM) 10:18:13.869342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7399): Terminating (SIGTERM) 10:18:13.909829 --- ParallelTerminationStrategy: PID 7387 died... 10:18:13.929258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7387): Terminated: ok {rc=0} 10:18:13.973543 --- ParallelTerminationStrategy: PID 7388 died... 10:18:13.992286 run iperf3-srv_10.42.42.10(pid=7388): Terminated {rc=256} 10:18:14.036392 --- ParallelTerminationStrategy: PID 7389 died... 10:18:14.055431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7389): Terminated: ok {rc=0} 10:18:14.099531 --- ParallelTerminationStrategy: PID 7390 died... 10:18:14.118297 run iperf3-srv_10.42.42.10(pid=7390): Terminated {rc=256} 10:18:14.162057 --- ParallelTerminationStrategy: PID 7393 died... 10:18:14.180934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7393): Terminated: ok {rc=0} 10:18:14.225165 --- ParallelTerminationStrategy: PID 7396 died... 10:18:14.243966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7396): Terminated: ok {rc=0} 10:18:14.288088 --- ParallelTerminationStrategy: PID 7399 died... 10:18:14.306909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7399): Terminated: ok {rc=0} 10:18:14.393078 bus /gobi_0: Setting Powered False 10:18:15.492885 bus /gobi_0: Setting Powered False 10:18:16.624426 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:18:17.787790 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:17.799861 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:18:17.874867 tst iperf3.py: using LAC 40242 10:18:18.002378 tst iperf3.py: using RAC 207 10:18:18.131799 tst iperf3.py: using CellId 40242 10:18:18.260820 tst iperf3.py: using BVCI 40243 10:18:18.379580 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:18.390961 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:18.402823 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:18.414099 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:18.425187 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:18.436320 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:18.447645 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:18.458757 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:18.470154 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:18:18.587299 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:18:18.794746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:18:19.103598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7401): Launched 10:18:19.372352 run iperf3-srv_10.42.42.10(pid=7402): Launched 10:18:19.487989 tst iperf3.py:8: start network... 10:18:19.694015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:20.170916 run create_hlr_db(pid=7403): Launched 10:18:20.290986 bus /gobi_6: Setting Powered False 10:18:21.351947 run create_hlr_db(pid=7403): Terminated: ok {rc=0} 10:18:21.802313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7405): Launched 10:18:22.130027 run osmo-hlr_10.42.42.2(pid=7406): Launched 10:18:22.257788 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:22.823596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7408): Launched 10:18:23.153686 run osmo-stp_10.42.42.5(pid=7409): Launched 10:18:23.279079 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:18:23.844020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7411): Launched 10:18:23.970358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:18:24.248517 run patchelf(pid=7412): Launched 10:18:24.433217 run osmo-stp_10.42.42.5(pid=7409): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7409)] 10:18:24.571708 run osmo-stp_10.42.42.5(pid=7409): stdout: | (launched: 2022-12-14_10:18:23.093739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:24.712141 run osmo-stp_10.42.42.5(pid=7409): stderr: | 20221214101823287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101823287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101823288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101823288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101823288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101823289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101823289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:24.852458 run osmo-stp_10.42.42.5(pid=7409): stdout: | (launched: 2022-12-14_10:18:23.093739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:24.986481 run osmo-stp_10.42.42.5(pid=7409): stderr: | 20221214101823287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101823287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101823288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101823288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101823288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101823289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101823289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:25.145243 run patchelf(pid=7412): Terminating (SIGINT) 10:18:25.329680 run patchelf(pid=7412): Terminated: ok {rc=0} 10:18:25.463441 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7409): Process ended prematurely: osmo-stp_10.42.42.5(pid=7409) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7409)] [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 10:18:25.473922 tst iperf3.py:8: Test FAILED (7.7 sec) 10:18:25.502899 run osmo-hlr_10.42.42.2(pid=7406): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7406)] 10:18:25.554110 run osmo-hlr_10.42.42.2(pid=7406): stdout: | (launched: 2022-12-14_10:18:22.069929) 10:18:25.606933 run osmo-hlr_10.42.42.2(pid=7406): stderr: | 20221214101822269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101822269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101822269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101822269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101822269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101822269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101822286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101822295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101822296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101822296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:25.660086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7401): Terminating (SIGTERM) 10:18:25.702480 run iperf3-srv_10.42.42.10(pid=7402): Terminating (SIGTERM) 10:18:25.744681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7405): Terminating (SIGTERM) 10:18:25.787462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7408): Terminating (SIGTERM) 10:18:25.829880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7411): Terminating (SIGTERM) 10:18:25.872620 --- ParallelTerminationStrategy: PID 7401 died... 10:18:25.892752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7401): Terminated: ok {rc=0} 10:18:25.939508 --- ParallelTerminationStrategy: PID 7402 died... 10:18:25.959178 run iperf3-srv_10.42.42.10(pid=7402): Terminated {rc=256} 10:18:26.005419 --- ParallelTerminationStrategy: PID 7405 died... 10:18:26.025309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7405): Terminated: ok {rc=0} 10:18:26.072012 --- ParallelTerminationStrategy: PID 7408 died... 10:18:26.091792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7408): Terminated: ok {rc=0} 10:18:26.138096 --- ParallelTerminationStrategy: PID 7411 died... 10:18:26.158018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7411): Terminated: ok {rc=0} 10:18:26.246689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:18:27.398306 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:27.410376 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:18:27.484159 tst iperf3m4.py: using LAC 40243 10:18:27.614226 tst iperf3m4.py: using RAC 208 10:18:27.742881 tst iperf3m4.py: using CellId 40243 10:18:27.871046 tst iperf3m4.py: using BVCI 40244 10:18:27.991979 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:28.003348 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:28.014644 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:28.025811 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:28.037439 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:28.049249 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:28.061261 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:28.072921 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:28.084821 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:18:28.205221 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:18:28.326279 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:18:28.447238 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:18:28.567104 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:18:28.774872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:18:29.085085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7413): Launched 10:18:29.354966 run iperf3-srv_10.42.42.10(pid=7414): Launched 10:18:29.473140 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:18:29.680288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:18:29.990454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7415): Launched 10:18:30.262369 run iperf3-srv_10.42.42.10(pid=7416): Launched 10:18:30.379693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:18:30.585414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:18:30.902431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7417): Launched 10:18:31.231296 run iperf3-srv_10.42.42.10(pid=7418): Launched 10:18:31.366128 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:18:31.576672 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:18:31.893453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7419): Launched 10:18:32.182842 run iperf3-srv_10.42.42.10(pid=7420): Launched 10:18:32.340829 tst iperf3m4.py:8: start network... 10:18:32.564902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:33.075017 run create_hlr_db(pid=7421): Launched 10:18:33.208295 bus /gobi_6: Setting Powered False 10:18:34.272228 run create_hlr_db(pid=7421): Terminated: ok {rc=0} 10:18:34.730966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7423): Launched 10:18:35.061656 run osmo-hlr_10.42.42.2(pid=7424): Launched 10:18:35.187836 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:35.756372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7426): Launched 10:18:36.085273 run osmo-stp_10.42.42.5(pid=7427): Launched 10:18:36.209546 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:18:36.773395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7429): Launched 10:18:36.899600 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:18:37.177669 run patchelf(pid=7430): Launched 10:18:37.362916 run osmo-stp_10.42.42.5(pid=7427): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7427)] 10:18:37.502527 run osmo-stp_10.42.42.5(pid=7427): stdout: | (launched: 2022-12-14_10:18:36.025053) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:37.643523 run osmo-stp_10.42.42.5(pid=7427): stderr: | 20221214101836216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101836217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101836217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101836217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101836218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101836218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101836218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:37.783660 run osmo-stp_10.42.42.5(pid=7427): stdout: | (launched: 2022-12-14_10:18:36.025053) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:37.918107 run osmo-stp_10.42.42.5(pid=7427): stderr: | 20221214101836216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101836217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101836217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101836217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101836218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101836218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101836218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:38.076694 run patchelf(pid=7430): Terminating (SIGINT) 10:18:38.260866 run patchelf(pid=7430): Terminated: ok {rc=0} 10:18:38.394750 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7427): Process ended prematurely: osmo-stp_10.42.42.5(pid=7427) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7427)] [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:18:38.405003 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:18:38.433946 run osmo-hlr_10.42.42.2(pid=7424): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7424)] 10:18:38.484185 run osmo-hlr_10.42.42.2(pid=7424): stdout: | (launched: 2022-12-14_10:18:35.001500) 10:18:38.536106 run osmo-hlr_10.42.42.2(pid=7424): stderr: | 20221214101835201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101835201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101835201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101835201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101835201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101835201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101835214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101835222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101835222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101835222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:38.588475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7413): Terminating (SIGTERM) 10:18:38.630441 run iperf3-srv_10.42.42.10(pid=7414): Terminating (SIGTERM) 10:18:38.672275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7415): Terminating (SIGTERM) 10:18:38.714276 run iperf3-srv_10.42.42.10(pid=7416): Terminating (SIGTERM) 10:18:38.756112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7417): Terminating (SIGTERM) 10:18:38.798171 run iperf3-srv_10.42.42.10(pid=7418): Terminating (SIGTERM) 10:18:38.839985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7419): Terminating (SIGTERM) 10:18:38.882074 run iperf3-srv_10.42.42.10(pid=7420): Terminating (SIGTERM) 10:18:38.923871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7423): Terminating (SIGTERM) 10:18:38.965733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7426): Terminating (SIGTERM) 10:18:39.007513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7429): Terminating (SIGTERM) 10:18:39.049577 --- ParallelTerminationStrategy: PID 7413 died... 10:18:39.069857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7413): Terminated: ok {rc=0} 10:18:39.116527 --- ParallelTerminationStrategy: PID 7414 died... 10:18:39.136148 run iperf3-srv_10.42.42.10(pid=7414): Terminated {rc=256} 10:18:39.182713 --- ParallelTerminationStrategy: PID 7415 died... 10:18:39.202547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7415): Terminated: ok {rc=0} 10:18:39.249027 --- ParallelTerminationStrategy: PID 7416 died... 10:18:39.268660 run iperf3-srv_10.42.42.10(pid=7416): Terminated {rc=256} 10:18:39.315069 --- ParallelTerminationStrategy: PID 7417 died... 10:18:39.334757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7417): Terminated: ok {rc=0} 10:18:39.381522 --- ParallelTerminationStrategy: PID 7418 died... 10:18:39.401170 run iperf3-srv_10.42.42.10(pid=7418): Terminated {rc=256} 10:18:39.447763 --- ParallelTerminationStrategy: PID 7419 died... 10:18:39.467545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7419): Terminated: ok {rc=0} 10:18:39.513914 --- ParallelTerminationStrategy: PID 7420 died... 10:18:39.533726 run iperf3-srv_10.42.42.10(pid=7420): Terminated {rc=256} 10:18:39.580109 --- ParallelTerminationStrategy: PID 7423 died... 10:18:39.599874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7423): Terminated: ok {rc=0} 10:18:39.646313 --- ParallelTerminationStrategy: PID 7426 died... 10:18:39.666111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7426): Terminated: ok {rc=0} 10:18:39.712449 --- ParallelTerminationStrategy: PID 7429 died... 10:18:39.732189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7429): Terminated: ok {rc=0} 10:18:39.820565 bus /gobi_4: Setting Powered False 10:18:40.920175 bus /gobi_4: Setting Powered False 10:18:42.037497 bus /gobi_1: Setting Powered False 10:18:43.134675 bus /gobi_1: Setting Powered False 10:18:44.251069 bus /gobi_0: Setting Powered False 10:18:45.351143 bus /gobi_0: Setting Powered False 10:18:46.470978 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:18:47.576648 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:47.588189 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:18:47.660208 tst ping.py: using LAC 40244 10:18:47.779958 tst ping.py: using RAC 209 10:18:47.899986 tst ping.py: using CellId 40244 10:18:48.020552 tst ping.py: using BVCI 40245 10:18:48.130453 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:48.141542 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:48.152160 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:48.162924 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:48.174318 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:48.185829 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:48.197461 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:48.209072 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:18:48.330457 tst ping.py:19: start network... 10:18:48.549555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:49.049319 run create_hlr_db(pid=7431): Launched 10:18:49.181752 bus /gobi_6: Setting Powered False 10:18:50.242417 run create_hlr_db(pid=7431): Terminated: ok {rc=0} 10:18:50.676091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7433): Launched 10:18:50.980571 run osmo-hlr_10.42.42.2(pid=7434): Launched 10:18:51.098204 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:51.646120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7436): Launched 10:18:51.947088 run osmo-stp_10.42.42.5(pid=7437): Launched 10:18:52.062390 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:18:52.582849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7439): Launched 10:18:52.698469 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:18:52.952661 run patchelf(pid=7440): Launched 10:18:53.120706 run osmo-stp_10.42.42.5(pid=7437): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7437)] 10:18:53.248126 run osmo-stp_10.42.42.5(pid=7437): stdout: | (launched: 2022-12-14_10:18:51.891508) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:53.377265 run osmo-stp_10.42.42.5(pid=7437): stderr: | 20221214101852061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101852061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101852061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101852062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101852062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101852062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101852062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:53.506574 run osmo-stp_10.42.42.5(pid=7437): stdout: | (launched: 2022-12-14_10:18:51.891508) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:53.629211 run osmo-stp_10.42.42.5(pid=7437): stderr: | 20221214101852061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101852061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101852061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101852062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101852062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101852062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101852062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:53.774446 run patchelf(pid=7440): Terminating (SIGINT) 10:18:53.943593 run patchelf(pid=7440): Terminated: ok {rc=0} 10:18:54.065640 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7437): Process ended prematurely: osmo-stp_10.42.42.5(pid=7437) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7437)] [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 10:18:54.074644 tst ping.py:22: Test FAILED (6.5 sec) 10:18:54.101574 run osmo-hlr_10.42.42.2(pid=7434): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7434)] 10:18:54.149880 run osmo-hlr_10.42.42.2(pid=7434): stdout: | (launched: 2022-12-14_10:18:50.924438) 10:18:54.199684 run osmo-hlr_10.42.42.2(pid=7434): stderr: | 20221214101851102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101851103 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101851103 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101851103 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101851103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101851103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101851115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101851123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101851124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101851124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:54.249825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7433): Terminating (SIGTERM) 10:18:54.290014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7436): Terminating (SIGTERM) 10:18:54.330106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7439): Terminating (SIGTERM) 10:18:54.370442 --- ParallelTerminationStrategy: PID 7433 died... 10:18:54.390185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7433): Terminated: ok {rc=0} 10:18:54.434540 --- ParallelTerminationStrategy: PID 7436 died... 10:18:54.453392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7436): Terminated: ok {rc=0} 10:18:54.497259 --- ParallelTerminationStrategy: PID 7439 died... 10:18:54.516105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7439): Terminated: ok {rc=0} 10:18:54.603648 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:18:55.692160 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:55.703718 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:18:55.778216 tst ping_idle_ping.py: using LAC 40245 10:18:55.897282 tst ping_idle_ping.py: using RAC 210 10:18:56.013631 tst ping_idle_ping.py: using CellId 40245 10:18:56.130202 tst ping_idle_ping.py: using BVCI 40246 10:18:56.241553 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:56.252380 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:56.263140 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:56.273844 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:56.284602 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:56.295621 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:56.306740 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:18:56.317807 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:18:56.438845 tst ping_idle_ping.py:24: start network... 10:18:56.657462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:57.160831 run create_hlr_db(pid=7441): Launched 10:18:57.292652 bus /gobi_6: Setting Powered False 10:18:58.356822 run create_hlr_db(pid=7441): Terminated: ok {rc=0} 10:18:58.793554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7443): Launched 10:18:59.097716 run osmo-hlr_10.42.42.2(pid=7444): Launched 10:18:59.213728 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:59.748192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7446): Launched 10:19:00.050173 run osmo-stp_10.42.42.5(pid=7447): Launched 10:19:00.166140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:00.686664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7449): Launched 10:19:00.802975 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:01.078966 run patchelf(pid=7450): Launched 10:19:01.266341 run osmo-stp_10.42.42.5(pid=7447): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7447)] 10:19:01.398696 run osmo-stp_10.42.42.5(pid=7447): stdout: | (launched: 2022-12-14_10:18:59.994553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:01.533763 run osmo-stp_10.42.42.5(pid=7447): stderr: | 20221214101900161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101900161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101900162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101900162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101900162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101900163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101900163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:01.668681 run osmo-stp_10.42.42.5(pid=7447): stdout: | (launched: 2022-12-14_10:18:59.994553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:01.797844 run osmo-stp_10.42.42.5(pid=7447): stderr: | 20221214101900161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101900161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101900162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101900162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101900162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101900163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101900163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:01.950393 run patchelf(pid=7450): Terminating (SIGINT) 10:19:02.128803 run patchelf(pid=7450): Terminated: ok {rc=0} 10:19:02.255098 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7447): Process ended prematurely: osmo-stp_10.42.42.5(pid=7447) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7447)] [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:19:02.264359 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:19:02.291598 run osmo-hlr_10.42.42.2(pid=7444): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7444)] 10:19:02.340182 run osmo-hlr_10.42.42.2(pid=7444): stdout: | (launched: 2022-12-14_10:18:59.041378) 10:19:02.390503 run osmo-hlr_10.42.42.2(pid=7444): stderr: | 20221214101859216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101859216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101859216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101859216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101859217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101859217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101859239 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101859248 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101859248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101859248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:02.443175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7443): Terminating (SIGTERM) 10:19:02.483477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7446): Terminating (SIGTERM) 10:19:02.523989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7449): Terminating (SIGTERM) 10:19:02.565138 --- ParallelTerminationStrategy: PID 7443 died... 10:19:02.584834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7443): Terminated: ok {rc=0} 10:19:02.629363 --- ParallelTerminationStrategy: PID 7446 died... 10:19:02.648311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7446): Terminated: ok {rc=0} 10:19:02.692521 --- ParallelTerminationStrategy: PID 7449 died... 10:19:02.711719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7449): Terminated: ok {rc=0} 10:19:02.797887 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:19:04.104201 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:19:04.111128 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:19:04.145380 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 10:19:04.183885 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 10:19:04.270153 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:19:04.303099 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 10:19:04.341447 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 10:19:04.941885 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 10:19:04.992000 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:05.003340 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:19:05.054206 tst cs_paging_gprs_active.py: using LAC 40246 10:19:05.175015 tst cs_paging_gprs_active.py: using RAC 211 10:19:05.296361 tst cs_paging_gprs_active.py: using CellId 40246 10:19:05.415415 tst cs_paging_gprs_active.py: using BVCI 40247 10:19:05.527349 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:05.538585 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:05.549707 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:05.560581 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:05.571917 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:05.583198 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:05.594613 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:05.605893 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:05.617560 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:19:05.739034 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:19:05.858562 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:19:06.068144 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:06.380678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7454): Launched 10:19:06.651610 run iperf3-srv_10.42.42.10(pid=7455): Launched 10:19:06.767985 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:19:06.974294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:07.284565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7456): Launched 10:19:07.554975 run iperf3-srv_10.42.42.10(pid=7457): Launched 10:19:07.671266 tst cs_paging_gprs_active.py:38: start network... 10:19:07.877253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:08.354318 run create_hlr_db(pid=7458): Launched 10:19:08.473827 bus /gobi_6: Setting Powered False 10:19:09.535446 run create_hlr_db(pid=7458): Terminated: ok {rc=0} 10:19:09.984767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7460): Launched 10:19:10.315041 run osmo-hlr_10.42.42.2(pid=7461): Launched 10:19:10.443704 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:11.010857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7463): Launched 10:19:11.340366 run osmo-stp_10.42.42.5(pid=7464): Launched 10:19:11.466560 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:12.034763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7466): Launched 10:19:12.162799 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:12.442124 run patchelf(pid=7467): Launched 10:19:12.628742 run osmo-stp_10.42.42.5(pid=7464): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7464)] 10:19:12.768215 run osmo-stp_10.42.42.5(pid=7464): stdout: | (launched: 2022-12-14_10:19:11.279677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:12.908514 run osmo-stp_10.42.42.5(pid=7464): stderr: | 20221214101911473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101911473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101911473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101911474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101911474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101911474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101911474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:13.049065 run osmo-stp_10.42.42.5(pid=7464): stdout: | (launched: 2022-12-14_10:19:11.279677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:13.183408 run osmo-stp_10.42.42.5(pid=7464): stderr: | 20221214101911473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101911473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101911473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101911474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101911474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101911474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101911474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:13.342698 run patchelf(pid=7467): Terminating (SIGINT) 10:19:13.527766 run patchelf(pid=7467): Terminated: ok {rc=0} 10:19:13.660755 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7464): Process ended prematurely: osmo-stp_10.42.42.5(pid=7464) [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7464)] [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 10:19:13.671222 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:19:13.700146 run osmo-hlr_10.42.42.2(pid=7461): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7461)] 10:19:13.750656 run osmo-hlr_10.42.42.2(pid=7461): stdout: | (launched: 2022-12-14_10:19:10.255036) 10:19:13.803483 run osmo-hlr_10.42.42.2(pid=7461): stderr: | 20221214101910453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101910453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101910453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101910453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101910453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101910453 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101910466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101910474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101910475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101910475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:13.856495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7454): Terminating (SIGTERM) 10:19:13.898935 run iperf3-srv_10.42.42.10(pid=7455): Terminating (SIGTERM) 10:19:13.941317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7456): Terminating (SIGTERM) 10:19:13.983774 run iperf3-srv_10.42.42.10(pid=7457): Terminating (SIGTERM) 10:19:14.026262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7460): Terminating (SIGTERM) 10:19:14.068679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7463): Terminating (SIGTERM) 10:19:14.110852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7466): Terminating (SIGTERM) 10:19:14.153270 --- ParallelTerminationStrategy: PID 7454 died... 10:19:14.173579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7454): Terminated: ok {rc=0} 10:19:14.220428 --- ParallelTerminationStrategy: PID 7455 died... 10:19:14.240105 run iperf3-srv_10.42.42.10(pid=7455): Terminated {rc=256} 10:19:14.286502 --- ParallelTerminationStrategy: PID 7456 died... 10:19:14.306247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7456): Terminated: ok {rc=0} 10:19:14.352790 --- ParallelTerminationStrategy: PID 7457 died... 10:19:14.373159 run iperf3-srv_10.42.42.10(pid=7457): Terminated {rc=256} 10:19:14.419960 --- ParallelTerminationStrategy: PID 7460 died... 10:19:14.440028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7460): Terminated: ok {rc=0} 10:19:14.486578 --- ParallelTerminationStrategy: PID 7463 died... 10:19:14.506393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7463): Terminated: ok {rc=0} 10:19:14.553368 --- ParallelTerminationStrategy: PID 7466 died... 10:19:14.573473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7466): Terminated: ok {rc=0} 10:19:14.662425 bus /gobi_0: Setting Powered False 10:19:15.762359 bus /gobi_0: Setting Powered False 10:19:16.881160 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 10:19:18.045390 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:18.057995 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:19:18.119305 tst iperf3.py: using LAC 40247 10:19:18.247272 tst iperf3.py: using RAC 212 10:19:18.373954 tst iperf3.py: using CellId 40247 10:19:18.501735 tst iperf3.py: using BVCI 40248 10:19:18.621591 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:18.633726 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:18.645338 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:18.656870 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:18.668382 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:18.680103 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:18.692027 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:18.703501 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:18.715218 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:19:18.833484 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:19:19.041730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:19.353988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7469): Launched 10:19:19.627378 run iperf3-srv_10.42.42.10(pid=7470): Launched 10:19:19.743800 tst iperf3.py:8: start network... 10:19:19.950801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:20.429061 run create_hlr_db(pid=7471): Launched 10:19:20.547471 bus /gobi_6: Setting Powered False 10:19:21.608693 run create_hlr_db(pid=7471): Terminated: ok {rc=0} 10:19:22.037811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7473): Launched 10:19:22.347425 run osmo-hlr_10.42.42.2(pid=7474): Launched 10:19:22.466793 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:22.999665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7476): Launched 10:19:23.308526 run osmo-stp_10.42.42.5(pid=7477): Launched 10:19:23.428558 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:23.961230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7479): Launched 10:19:24.080063 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:24.342259 run patchelf(pid=7480): Launched 10:19:24.517489 run osmo-stp_10.42.42.5(pid=7477): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7477)] 10:19:24.648583 run osmo-stp_10.42.42.5(pid=7477): stdout: | (launched: 2022-12-14_10:19:23.251993) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:24.781527 run osmo-stp_10.42.42.5(pid=7477): stderr: | 20221214101923422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101923422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101923423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101923423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101923423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101923424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101923424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:24.914197 run osmo-stp_10.42.42.5(pid=7477): stdout: | (launched: 2022-12-14_10:19:23.251993) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:25.040923 run osmo-stp_10.42.42.5(pid=7477): stderr: | 20221214101923422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101923422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101923423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101923423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101923423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101923424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101923424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:25.190893 run patchelf(pid=7480): Terminating (SIGINT) 10:19:25.364778 run patchelf(pid=7480): Terminated: ok {rc=0} 10:19:25.490436 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7477): Process ended prematurely: osmo-stp_10.42.42.5(pid=7477) [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7477)] [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 10:19:25.500073 tst iperf3.py:8: Test FAILED (7.5 sec) 10:19:25.527529 run osmo-hlr_10.42.42.2(pid=7474): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7474)] 10:19:25.575840 run osmo-hlr_10.42.42.2(pid=7474): stdout: | (launched: 2022-12-14_10:19:22.290347) 10:19:25.625572 run osmo-hlr_10.42.42.2(pid=7474): stderr: | 20221214101922469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101922469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101922469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101922469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101922469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101922469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101922480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101922489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101922489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101922489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:25.675549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7469): Terminating (SIGTERM) 10:19:25.715716 run iperf3-srv_10.42.42.10(pid=7470): Terminating (SIGTERM) 10:19:25.755636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7473): Terminating (SIGTERM) 10:19:25.795549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7476): Terminating (SIGTERM) 10:19:25.835564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7479): Terminating (SIGTERM) 10:19:25.876330 --- ParallelTerminationStrategy: PID 7469 died... 10:19:25.895873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7469): Terminated: ok {rc=0} 10:19:25.940031 --- ParallelTerminationStrategy: PID 7470 died... 10:19:25.958938 run iperf3-srv_10.42.42.10(pid=7470): Terminated {rc=256} 10:19:26.002950 --- ParallelTerminationStrategy: PID 7473 died... 10:19:26.021934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7473): Terminated: ok {rc=0} 10:19:26.065885 --- ParallelTerminationStrategy: PID 7476 died... 10:19:26.084806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7476): Terminated: ok {rc=0} 10:19:26.128834 --- ParallelTerminationStrategy: PID 7479 died... 10:19:26.148252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7479): Terminated: ok {rc=0} 10:19:26.232992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 10:19:27.377781 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:27.389789 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:19:27.444218 tst iperf3m4.py: using LAC 40248 10:19:27.567898 tst iperf3m4.py: using RAC 213 10:19:27.689365 tst iperf3m4.py: using CellId 40248 10:19:27.810455 tst iperf3m4.py: using BVCI 40249 10:19:27.924777 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:27.936229 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:27.947507 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:27.958756 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:27.970947 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:27.982997 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:27.995184 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:28.007147 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:28.019352 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:19:28.144213 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:19:28.265552 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:19:28.387214 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:19:28.507317 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:19:28.727989 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:29.060211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7482): Launched 10:19:29.349108 run iperf3-srv_10.42.42.10(pid=7483): Launched 10:19:29.475271 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:19:29.697826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:30.029639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7484): Launched 10:19:30.318059 run iperf3-srv_10.42.42.10(pid=7485): Launched 10:19:30.443452 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:19:30.665690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:31.022903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7487): Launched 10:19:31.324422 run iperf3-srv_10.42.42.10(pid=7488): Launched 10:19:31.463637 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:19:31.689557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:32.029670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7489): Launched 10:19:32.333723 run iperf3-srv_10.42.42.10(pid=7490): Launched 10:19:32.459781 tst iperf3m4.py:8: start network... 10:19:32.681305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:33.192529 run create_hlr_db(pid=7491): Launched 10:19:33.328099 bus /gobi_6: Setting Powered False 10:19:34.392559 run create_hlr_db(pid=7491): Terminated: ok {rc=0} 10:19:34.850554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7493): Launched 10:19:35.179207 run osmo-hlr_10.42.42.2(pid=7494): Launched 10:19:35.305398 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:35.874996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7496): Launched 10:19:36.204908 run osmo-stp_10.42.42.5(pid=7497): Launched 10:19:36.329256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:36.894021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7499): Launched 10:19:37.019664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:37.296897 run patchelf(pid=7500): Launched 10:19:37.482257 run osmo-stp_10.42.42.5(pid=7497): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7497)] 10:19:37.621217 run osmo-stp_10.42.42.5(pid=7497): stdout: | (launched: 2022-12-14_10:19:36.144122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:37.761420 run osmo-stp_10.42.42.5(pid=7497): stderr: | 20221214101936333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101936333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101936333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101936334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101936334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101936334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101936334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:37.902197 run osmo-stp_10.42.42.5(pid=7497): stdout: | (launched: 2022-12-14_10:19:36.144122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:38.036309 run osmo-stp_10.42.42.5(pid=7497): stderr: | 20221214101936333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101936333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101936333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101936334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101936334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101936334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101936334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:38.195572 run patchelf(pid=7500): Terminating (SIGINT) 10:19:38.380219 run patchelf(pid=7500): Terminated: ok {rc=0} 10:19:38.514199 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7497): Process ended prematurely: osmo-stp_10.42.42.5(pid=7497) [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7497)] [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 10:19:38.524643 tst iperf3m4.py:8: Test FAILED (11.2 sec) 10:19:38.553891 run osmo-hlr_10.42.42.2(pid=7494): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7494)] 10:19:38.604394 run osmo-hlr_10.42.42.2(pid=7494): stdout: | (launched: 2022-12-14_10:19:35.119651) 10:19:38.656597 run osmo-hlr_10.42.42.2(pid=7494): stderr: | 20221214101935315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101935315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101935315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101935315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101935315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101935315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101935327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101935336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101935336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101935336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:38.708936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7482): Terminating (SIGTERM) 10:19:38.751363 run iperf3-srv_10.42.42.10(pid=7483): Terminating (SIGTERM) 10:19:38.793552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7484): Terminating (SIGTERM) 10:19:38.835894 run iperf3-srv_10.42.42.10(pid=7485): Terminating (SIGTERM) 10:19:38.878087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7487): Terminating (SIGTERM) 10:19:38.920085 run iperf3-srv_10.42.42.10(pid=7488): Terminating (SIGTERM) 10:19:38.962092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7489): Terminating (SIGTERM) 10:19:39.004113 run iperf3-srv_10.42.42.10(pid=7490): Terminating (SIGTERM) 10:19:39.045986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7493): Terminating (SIGTERM) 10:19:39.088157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7496): Terminating (SIGTERM) 10:19:39.130140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7499): Terminating (SIGTERM) 10:19:39.172195 --- ParallelTerminationStrategy: PID 7482 died... 10:19:39.192421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7482): Terminated: ok {rc=0} 10:19:39.238815 --- ParallelTerminationStrategy: PID 7483 died... 10:19:39.258305 run iperf3-srv_10.42.42.10(pid=7483): Terminated {rc=256} 10:19:39.304270 --- ParallelTerminationStrategy: PID 7484 died... 10:19:39.324131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7484): Terminated: ok {rc=0} 10:19:39.370380 --- ParallelTerminationStrategy: PID 7485 died... 10:19:39.390370 run iperf3-srv_10.42.42.10(pid=7485): Terminated {rc=256} 10:19:39.436389 --- ParallelTerminationStrategy: PID 7487 died... 10:19:39.456164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7487): Terminated: ok {rc=0} 10:19:39.502431 --- ParallelTerminationStrategy: PID 7488 died... 10:19:39.522048 run iperf3-srv_10.42.42.10(pid=7488): Terminated {rc=256} 10:19:39.568094 --- ParallelTerminationStrategy: PID 7489 died... 10:19:39.587648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7489): Terminated: ok {rc=0} 10:19:39.633652 --- ParallelTerminationStrategy: PID 7490 died... 10:19:39.653255 run iperf3-srv_10.42.42.10(pid=7490): Terminated {rc=256} 10:19:39.699188 --- ParallelTerminationStrategy: PID 7493 died... 10:19:39.718776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7493): Terminated: ok {rc=0} 10:19:39.764657 --- ParallelTerminationStrategy: PID 7496 died... 10:19:39.784203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7496): Terminated: ok {rc=0} 10:19:39.829999 --- ParallelTerminationStrategy: PID 7499 died... 10:19:39.849543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7499): Terminated: ok {rc=0} 10:19:39.937692 bus /gobi_4: Setting Powered False 10:19:41.037906 bus /gobi_4: Setting Powered False 10:19:42.154263 bus /gobi_1: Setting Powered False 10:19:43.253473 bus /gobi_1: Setting Powered False 10:19:44.370065 bus /gobi_0: Setting Powered False 10:19:45.467282 bus /gobi_0: Setting Powered False 10:19:46.602232 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 10:19:47.720007 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:47.732461 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:19:47.787811 tst ping.py: using LAC 40249 10:19:47.914831 tst ping.py: using RAC 214 10:19:48.043013 tst ping.py: using CellId 40249 10:19:48.169401 tst ping.py: using BVCI 40250 10:19:48.287218 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:48.299116 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:48.310802 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:48.322461 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:48.334068 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:48.345765 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:48.357548 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:48.369147 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:19:48.488484 tst ping.py:19: start network... 10:19:48.705921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:49.203154 run create_hlr_db(pid=7501): Launched 10:19:49.335701 bus /gobi_6: Setting Powered False 10:19:50.398023 run create_hlr_db(pid=7501): Terminated: ok {rc=0} 10:19:50.820623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7503): Launched 10:19:51.114081 run osmo-hlr_10.42.42.2(pid=7504): Launched 10:19:51.224916 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:51.742092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7506): Launched 10:19:52.036157 run osmo-stp_10.42.42.5(pid=7507): Launched 10:19:52.147960 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:52.652542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7509): Launched 10:19:52.765563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:53.014693 run patchelf(pid=7510): Launched 10:19:53.178904 run osmo-stp_10.42.42.5(pid=7507): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7507)] 10:19:53.304070 run osmo-stp_10.42.42.5(pid=7507): stdout: | (launched: 2022-12-14_10:19:51.981912) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:53.430937 run osmo-stp_10.42.42.5(pid=7507): stderr: | 20221214101952147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101952147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101952147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101952148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101952148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101952148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101952148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:53.557635 run osmo-stp_10.42.42.5(pid=7507): stdout: | (launched: 2022-12-14_10:19:51.981912) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:53.677999 run osmo-stp_10.42.42.5(pid=7507): stderr: | 20221214101952147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214101952147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214101952147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214101952148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214101952148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214101952148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214101952148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:53.820629 run patchelf(pid=7510): Terminating (SIGINT) 10:19:53.986624 run patchelf(pid=7510): Terminated: ok {rc=0} 10:19:54.106593 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7507): Process ended prematurely: osmo-stp_10.42.42.5(pid=7507) [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7507)] [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 10:19:54.115546 tst ping.py:22: Test FAILED (6.4 sec) 10:19:54.142421 run osmo-hlr_10.42.42.2(pid=7504): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7504)] 10:19:54.190428 run osmo-hlr_10.42.42.2(pid=7504): stdout: | (launched: 2022-12-14_10:19:51.060147) 10:19:54.240103 run osmo-hlr_10.42.42.2(pid=7504): stderr: | 20221214101951233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101951233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101951233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101951233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101951233 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101951233 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101951247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101951257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101951257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101951257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:54.290154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7503): Terminating (SIGTERM) 10:19:54.330458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7506): Terminating (SIGTERM) 10:19:54.370691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7509): Terminating (SIGTERM) 10:19:54.411023 --- ParallelTerminationStrategy: PID 7503 died... 10:19:54.430514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7503): Terminated: ok {rc=0} 10:19:54.474991 --- ParallelTerminationStrategy: PID 7506 died... 10:19:54.493956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7506): Terminated: ok {rc=0} 10:19:54.538049 --- ParallelTerminationStrategy: PID 7509 died... 10:19:54.556882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7509): Terminated: ok {rc=0} 10:19:54.643844 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 10:19:55.731617 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:55.744089 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:19:55.797761 tst ping_idle_ping.py: using LAC 40250 10:19:55.913560 tst ping_idle_ping.py: using RAC 215 10:19:56.040510 tst ping_idle_ping.py: using CellId 40250 10:19:56.163647 tst ping_idle_ping.py: using BVCI 40251 10:19:56.279501 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:56.291517 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:56.303249 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:56.315022 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:56.327224 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:56.339635 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:56.352047 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:19:56.364126 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:19:56.480745 tst ping_idle_ping.py:24: start network... 10:19:56.677729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:57.135218 run create_hlr_db(pid=7511): Launched 10:19:57.247958 bus /gobi_6: Setting Powered False 10:19:58.307736 run create_hlr_db(pid=7511): Terminated: ok {rc=0} 10:19:58.739277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7513): Launched 10:19:59.054469 run osmo-hlr_10.42.42.2(pid=7514): Launched 10:19:59.173874 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:59.720740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7516): Launched 10:20:00.034366 run osmo-stp_10.42.42.5(pid=7517): Launched 10:20:00.154135 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:00.700551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7519): Launched 10:20:00.821069 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:01.099397 run patchelf(pid=7520): Launched 10:20:01.298246 run osmo-stp_10.42.42.5(pid=7517): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7517)] 10:20:01.428615 run osmo-stp_10.42.42.5(pid=7517): stdout: | (launched: 2022-12-14_10:19:59.976686) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:01.559243 run osmo-stp_10.42.42.5(pid=7517): stderr: | 20221214102000164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102000164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102000164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102000165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102000165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102000165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102000165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:01.691507 run osmo-stp_10.42.42.5(pid=7517): stdout: | (launched: 2022-12-14_10:19:59.976686) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:01.817248 run osmo-stp_10.42.42.5(pid=7517): stderr: | 20221214102000164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102000164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102000164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102000165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102000165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102000165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102000165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:01.965695 run patchelf(pid=7520): Terminating (SIGINT) 10:20:02.137776 run patchelf(pid=7520): Terminated: ok {rc=0} 10:20:02.262228 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7517): Process ended prematurely: osmo-stp_10.42.42.5(pid=7517) [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7517)] [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 10:20:02.271647 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:20:02.298666 run osmo-hlr_10.42.42.2(pid=7514): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7514)] 10:20:02.347630 run osmo-hlr_10.42.42.2(pid=7514): stdout: | (launched: 2022-12-14_10:19:58.996845) 10:20:02.397643 run osmo-hlr_10.42.42.2(pid=7514): stderr: | 20221214101959188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214101959188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214101959188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214101959188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214101959188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214101959188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214101959200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214101959208 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214101959208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214101959208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:02.447624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7513): Terminating (SIGTERM) 10:20:02.487578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7516): Terminating (SIGTERM) 10:20:02.527126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7519): Terminating (SIGTERM) 10:20:02.567291 --- ParallelTerminationStrategy: PID 7513 died... 10:20:02.586644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7513): Terminated: ok {rc=0} 10:20:02.630573 --- ParallelTerminationStrategy: PID 7516 died... 10:20:02.649651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7516): Terminated: ok {rc=0} 10:20:02.693843 --- ParallelTerminationStrategy: PID 7519 died... 10:20:02.712851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7519): Terminated: ok {rc=0} 10:20:02.799032 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:20:04.105181 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:20:04.111871 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:20:04.144728 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:20:04.179691 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:20:04.232568 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:20:04.266574 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:20:04.301629 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:20:04.856920 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:20:04.862747 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:20:04.874383 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:20:04.944073 tst switch_tch_pdch.py: using LAC 40251 10:20:05.059310 tst switch_tch_pdch.py: using RAC 216 10:20:05.175602 tst switch_tch_pdch.py: using CellId 40251 10:20:05.289540 tst switch_tch_pdch.py: using BVCI 40252 10:20:05.404325 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:20:05.416070 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:20:05.427508 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:20:05.438922 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:20:05.450568 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:20:05.462023 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:20:05.473645 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:20:05.484930 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:20:05.599459 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:20:05.718673 tst switch_tch_pdch.py:51: start network... 10:20:05.929247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:06.414744 run create_hlr_db(pid=7528): Launched 10:20:06.542598 bus /gobi_6: Setting Powered False 10:20:07.605196 run create_hlr_db(pid=7528): Terminated: ok {rc=0} 10:20:08.043282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7530): Launched 10:20:08.357120 run osmo-hlr_10.42.42.2(pid=7531): Launched 10:20:08.476801 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:09.021624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7533): Launched 10:20:09.335023 run osmo-stp_10.42.42.5(pid=7534): Launched 10:20:09.453956 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:09.992628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7536): Launched 10:20:10.111820 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:10.374945 run patchelf(pid=7537): Launched 10:20:10.549136 run osmo-stp_10.42.42.5(pid=7534): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7534)] 10:20:10.681705 run osmo-stp_10.42.42.5(pid=7534): stdout: | (launched: 2022-12-14_10:20:09.277470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:10.816184 run osmo-stp_10.42.42.5(pid=7534): stderr: | 20221214102009466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102009467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102009467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102009467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102009468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102009468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102009468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:10.950832 run osmo-stp_10.42.42.5(pid=7534): stdout: | (launched: 2022-12-14_10:20:09.277470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:11.079543 run osmo-stp_10.42.42.5(pid=7534): stderr: | 20221214102009466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102009467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102009467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102009467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102009468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102009468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102009468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:11.230920 run patchelf(pid=7537): Terminating (SIGINT) 10:20:11.406852 run patchelf(pid=7537): Terminated: ok {rc=0} 10:20:11.533555 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7534): Process ended prematurely: osmo-stp_10.42.42.5(pid=7534) [trial-2403↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7534)] [trial-2403↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:20:11.543226 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 10:20:11.571297 run osmo-hlr_10.42.42.2(pid=7531): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7531)] 10:20:11.621526 run osmo-hlr_10.42.42.2(pid=7531): stdout: | (launched: 2022-12-14_10:20:08.299461) 10:20:11.673541 run osmo-hlr_10.42.42.2(pid=7531): stderr: | 20221214102008493 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102008493 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102008493 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102008493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102008493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102008493 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102008505 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102008513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102008513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102008513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:11.725822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7530): Terminating (SIGTERM) 10:20:11.768067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7533): Terminating (SIGTERM) 10:20:11.810406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7536): Terminating (SIGTERM) 10:20:11.852785 --- ParallelTerminationStrategy: PID 7530 died... 10:20:11.873147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7530): Terminated: ok {rc=0} 10:20:11.919654 --- ParallelTerminationStrategy: PID 7533 died... 10:20:11.939236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7533): Terminated: ok {rc=0} 10:20:11.985181 --- ParallelTerminationStrategy: PID 7536 died... 10:20:12.004602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7536): Terminated: ok {rc=0} 10:20:12.093145 bus /gobi_0: Setting Powered False 10:20:13.191858 bus /gobi_0: Setting Powered False 10:20:14.309486 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:20:15.559296 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:20:15.565034 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:20:15.597705 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:20:15.632146 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:20:15.687053 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:20:15.720479 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:20:15.754577 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:20:16.342812 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:20:16.351283 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:20:16.366948 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:20:16.454585 tst switch_tch_pdch.py: using LAC 40252 10:20:16.575239 tst switch_tch_pdch.py: using RAC 217 10:20:16.699630 tst switch_tch_pdch.py: using CellId 40252 10:20:16.822792 tst switch_tch_pdch.py: using BVCI 40253 10:20:16.939495 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:20:16.951324 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:20:16.962446 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:20:16.973715 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:20:16.985892 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:20:16.998061 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:20:17.010310 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:20:17.022296 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:20:17.145168 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:20:17.270539 tst switch_tch_pdch.py:51: start network... 10:20:17.467601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:17.896846 run create_hlr_db(pid=7541): Launched 10:20:18.010542 bus /gobi_6: Setting Powered False 10:20:19.070020 run create_hlr_db(pid=7541): Terminated: ok {rc=0} 10:20:19.474727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7543): Launched 10:20:19.788620 run osmo-hlr_10.42.42.2(pid=7544): Launched 10:20:19.907781 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:20.419638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7546): Launched 10:20:20.733005 run osmo-stp_10.42.42.5(pid=7547): Launched 10:20:20.852557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:21.365306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7549): Launched 10:20:21.485813 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:21.750339 run patchelf(pid=7550): Launched 10:20:21.924253 run osmo-stp_10.42.42.5(pid=7547): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7547)] 10:20:22.057149 run osmo-stp_10.42.42.5(pid=7547): stdout: | (launched: 2022-12-14_10:20:20.675767) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:22.191825 run osmo-stp_10.42.42.5(pid=7547): stderr: | 20221214102020862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102020862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102020862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102020863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102020863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102020863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102020863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:22.326762 run osmo-stp_10.42.42.5(pid=7547): stdout: | (launched: 2022-12-14_10:20:20.675767) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:22.455204 run osmo-stp_10.42.42.5(pid=7547): stderr: | 20221214102020862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102020862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102020862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102020863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102020863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102020863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102020863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:22.607471 run patchelf(pid=7550): Terminating (SIGINT) 10:20:22.783761 run patchelf(pid=7550): Terminated: ok {rc=0} 10:20:22.910520 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7547): Process ended prematurely: osmo-stp_10.42.42.5(pid=7547) [trial-2403↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7547)] [trial-2403↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:20:22.920014 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 10:20:22.948141 run osmo-hlr_10.42.42.2(pid=7544): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7544)] 10:20:22.998257 run osmo-hlr_10.42.42.2(pid=7544): stdout: | (launched: 2022-12-14_10:20:19.730884) 10:20:23.050021 run osmo-hlr_10.42.42.2(pid=7544): stderr: | 20221214102019925 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102019925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102019925 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102019925 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102019925 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102019925 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102019937 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102019945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102019946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102019946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:23.102725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7543): Terminating (SIGTERM) 10:20:23.144555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7546): Terminating (SIGTERM) 10:20:23.186396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7549): Terminating (SIGTERM) 10:20:23.228403 --- ParallelTerminationStrategy: PID 7543 died... 10:20:23.248507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7543): Terminated: ok {rc=0} 10:20:23.294093 --- ParallelTerminationStrategy: PID 7546 died... 10:20:23.313613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7546): Terminated: ok {rc=0} 10:20:23.359094 --- ParallelTerminationStrategy: PID 7549 died... 10:20:23.378606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7549): Terminated: ok {rc=0} 10:20:23.466715 bus /gobi_0: Setting Powered False 10:20:24.564832 bus /gobi_0: Setting Powered False 10:20:25.683373 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 10:20:26.933373 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:20:26.937259 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:20:26.970014 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 10:20:26.978026 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 10:20:27.031573 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:20:27.065074 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 10:20:27.071702 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 10:20:27.607839 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 10:20:27.614036 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 10:20:27.625162 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:20:27.674355 tst mo_mt_sms.py: using LAC 40253 10:20:27.795959 tst mo_mt_sms.py: using RAC 218 10:20:27.911711 tst mo_mt_sms.py: using CellId 40253 10:20:28.025535 tst mo_mt_sms.py: using BVCI 40254 10:20:28.130391 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:20:28.249628 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:20:28.362921 tst mo_mt_sms.py:9: start nitb and bts... 10:20:28.559395 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:20:29.154793 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7554): Launched 10:20:29.446224 run osmo-nitb_10.42.42.2(pid=7555): Launched 10:20:29.608762 run osmo-nitb_10.42.42.2(pid=7555): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7555)] 10:20:29.740690 run osmo-nitb_10.42.42.2(pid=7555): stdout: | (launched: 2022-12-14_10:20:29.392161) 10:20:29.873887 run osmo-nitb_10.42.42.2(pid=7555): stderr: | (launched: 2022-12-14_10:20:29.435347) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:20:30.007396 run osmo-nitb_10.42.42.2(pid=7555): stdout: | (launched: 2022-12-14_10:20:29.392161) 10:20:30.135051 run osmo-nitb_10.42.42.2(pid=7555): stderr: | (launched: 2022-12-14_10:20:29.435347) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7555): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7555) [trial-2403↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7555)] 10:20:30.556870 tst osmo-nitb_10.42.42.2(pid=7555): stdout: | (launched: 2022-12-14_10:20:29.392161) 10:20:30.682090 tst osmo-nitb_10.42.42.2(pid=7555): stderr: | (launched: 2022-12-14_10:20:29.435347) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:20:30.819933 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=7555): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7555) [trial-2403↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7555)] [trial-2403↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 10:20:30.829027 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 10:20:30.836133 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7554): Terminating (SIGTERM) 10:20:31.048692 --- ParallelTerminationStrategy: PID 7554 died... 10:20:31.067766 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7554): Terminated: ok {rc=0} 10:20:31.157138 bus /sierra_3: Setting Powered False 10:20:32.254507 bus /sierra_3: Setting Powered False 10:20:33.372463 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 sms:trx-sysmocell5000 --------------------------------------------------------------------- 10:20:34.571402 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:20:34.575917 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:20:34.610403 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 10:20:34.638389 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 10:20:34.690703 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:20:34.725155 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 10:20:34.752103 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 10:20:35.296327 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 10:20:35.301576 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:20:35.312066 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:20:35.359505 tst mo_mt_sms.py: using LAC 40254 10:20:35.473051 tst mo_mt_sms.py: using RAC 219 10:20:35.586980 tst mo_mt_sms.py: using CellId 40254 10:20:35.701759 tst mo_mt_sms.py: using BVCI 40255 10:20:35.806437 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:20:35.817210 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:20:35.827592 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:20:35.837992 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:20:35.849225 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:20:35.860405 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:20:35.980879 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:20:36.098529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:36.579646 run create_hlr_db(pid=7559): Launched 10:20:36.706504 bus /sierra_2: Setting Powered False 10:20:37.768640 run create_hlr_db(pid=7559): Terminated: ok {rc=0} 10:20:38.186157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7561): Launched 10:20:38.477739 run osmo-hlr_10.42.42.2(pid=7562): Launched 10:20:38.588096 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:39.097279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7564): Launched 10:20:39.388091 run osmo-stp_10.42.42.5(pid=7565): Launched 10:20:39.499079 run osmo-msc_10.42.42.6: Starting osmo-msc 10:20:40.023779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7567): Launched 10:20:40.314331 run osmo-msc_10.42.42.6(pid=7568): Launched 10:20:40.476463 run osmo-stp_10.42.42.5(pid=7565): ERR: Terminated: ERROR {rc=1} [trial-2403↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7565)] 10:20:40.600452 run osmo-stp_10.42.42.5(pid=7565): stdout: | (launched: 2022-12-14_10:20:39.335013) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:40.723890 run osmo-stp_10.42.42.5(pid=7565): stderr: | 20221214102039500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102039501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102039501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102039501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102039502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102039502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102039502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:40.844745 run osmo-stp_10.42.42.5(pid=7565): stdout: | (launched: 2022-12-14_10:20:39.335013) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:40.960536 run osmo-stp_10.42.42.5(pid=7565): stderr: | 20221214102039500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102039501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102039501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102039501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102039502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102039502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102039502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:41.098806 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7565): Process ended prematurely: osmo-stp_10.42.42.5(pid=7565) [trial-2403↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7565)] [trial-2403↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 10:20:41.107156 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 10:20:41.133617 run osmo-hlr_10.42.42.2(pid=7562): ERR: Terminated: ERROR {rc=237} [trial-2403↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7562)] 10:20:41.181710 run osmo-hlr_10.42.42.2(pid=7562): stdout: | (launched: 2022-12-14_10:20:38.424349) 10:20:41.231528 run osmo-hlr_10.42.42.2(pid=7562): stderr: | 20221214102038594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102038594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102038594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102038594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102038594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102038595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102038608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102038619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102038619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102038619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:41.300785 run osmo-msc_10.42.42.6(pid=7568): ERR: Terminated: ERROR {rc=2} [trial-2403↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7568)] 10:20:41.348239 run osmo-msc_10.42.42.6(pid=7568): stdout: | (launched: 2022-12-14_10:20:40.261048) 10:20:41.397837 run osmo-msc_10.42.42.6(pid=7568): stderr: | 20221214102040527 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102040527 DLGLOBAL DEBUG validating counter group 0x7fa3ca065c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102040527 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102040527 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102040527 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102040527 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102040529 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102040530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102040530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102040530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:20:41.447921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7561): Terminating (SIGTERM) 10:20:41.487741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7564): Terminating (SIGTERM) 10:20:41.527638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7567): Terminating (SIGTERM) 10:20:41.567534 --- ParallelTerminationStrategy: PID 7561 died... 10:20:41.587063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7561): Terminated: ok {rc=0} 10:20:41.630974 --- ParallelTerminationStrategy: PID 7564 died... 10:20:41.649962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7564): Terminated: ok {rc=0} 10:20:41.693534 --- ParallelTerminationStrategy: PID 7567 died... 10:20:41.712344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7567): Terminated: ok {rc=0} 10:20:41.798558 bus /sierra_3: Setting Powered False 10:20:42.898750 bus /sierra_3: Setting Powered False 10:20:44.015595 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 10:20:45.247592 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:20:45.252428 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:20:45.288159 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 10:20:45.295588 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 10:20:45.331022 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:20:45.364598 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 10:20:45.371522 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 10:20:45.929496 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2403 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 10:20:45.935164 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 10:20:45.952781 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:20:46.007596 tst assert_extension.py: using LAC 40255 10:20:46.164481 tst assert_extension.py: using RAC 220 10:20:46.312057 tst assert_extension.py: using CellId 40255 10:20:46.456280 tst assert_extension.py: using BVCI 40256 10:20:46.572734 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 10:20:46.718131 tst assert_extension.py:10: start nitb and bts... 10:20:46.929560 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:20:47.537137 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7574): Launched 10:20:47.829348 run osmo-nitb_10.42.42.2(pid=7575): Launched 10:20:47.992243 run osmo-nitb_10.42.42.2(pid=7575): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7575)] 10:20:48.123998 run osmo-nitb_10.42.42.2(pid=7575): stdout: | (launched: 2022-12-14_10:20:47.776005) 10:20:48.256832 run osmo-nitb_10.42.42.2(pid=7575): stderr: | (launched: 2022-12-14_10:20:47.819234) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:20:48.390626 run osmo-nitb_10.42.42.2(pid=7575): stdout: | (launched: 2022-12-14_10:20:47.776005) 10:20:48.517926 run osmo-nitb_10.42.42.2(pid=7575): stderr: | (launched: 2022-12-14_10:20:47.819234) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7575): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7575) [trial-2403↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7575)] 10:20:48.940256 tst osmo-nitb_10.42.42.2(pid=7575): stdout: | (launched: 2022-12-14_10:20:47.776005) 10:20:49.057989 tst osmo-nitb_10.42.42.2(pid=7575): stderr: | (launched: 2022-12-14_10:20:47.819234) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:20:49.196628 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7575): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7575) [trial-2403↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7575)] [trial-2403↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 10:20:49.205073 tst assert_extension.py:12: Test FAILED (3.3 sec) 10:20:49.211650 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7574): Terminating (SIGTERM) 10:20:49.420449 --- ParallelTerminationStrategy: PID 7574 died... 10:20:49.441070 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7574): Terminated: ok {rc=0} 10:20:49.527030 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 10:20:50.705569 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:20:50.709586 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:20:50.742565 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 10:20:50.769616 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 10:20:50.809815 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:20:50.844374 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 10:20:50.870650 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 10:20:51.397367 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2403 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 10:20:51.402279 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:20:51.413144 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:20:51.460157 tst assert_extension.py: using LAC 40256 10:20:51.571662 tst assert_extension.py: using RAC 221 10:20:51.683097 tst assert_extension.py: using CellId 40256 10:20:51.794645 tst assert_extension.py: using BVCI 40257 10:20:51.899062 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:20:51.909767 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:20:51.920180 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:20:51.930581 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:20:51.941315 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:20:51.951924 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 10:20:52.068140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:52.516596 run create_hlr_db(pid=7581): Launched 10:20:52.628280 bus /sierra_2: Setting Powered False 10:20:53.687178 run create_hlr_db(pid=7581): Terminated: ok {rc=0} 10:20:54.114302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7583): Launched 10:20:54.425318 run osmo-hlr_10.42.42.2(pid=7584): Launched 10:20:54.545172 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:55.170987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7586): Launched 10:20:55.477212 run osmo-stp_10.42.42.5(pid=7587): Launched 10:20:55.587784 run osmo-msc_10.42.42.6: Starting osmo-msc 10:20:56.108105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7589): Launched 10:20:56.394713 run osmo-msc_10.42.42.6(pid=7590): Launched 10:20:56.555227 run osmo-stp_10.42.42.5(pid=7587): ERR: Terminated: ERROR {rc=1} [trial-2403↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7587)] 10:20:56.678116 run osmo-stp_10.42.42.5(pid=7587): stdout: | (launched: 2022-12-14_10:20:55.421190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:56.800023 run osmo-stp_10.42.42.5(pid=7587): stderr: | 20221214102055587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102055587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102055587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102055588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102055588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102055588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102055589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:56.919468 run osmo-stp_10.42.42.5(pid=7587): stdout: | (launched: 2022-12-14_10:20:55.421190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:57.033358 run osmo-stp_10.42.42.5(pid=7587): stderr: | 20221214102055587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102055587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102055587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102055588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102055588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102055588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102055589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:57.169891 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7587): Process ended prematurely: osmo-stp_10.42.42.5(pid=7587) [trial-2403↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7587)] [trial-2403↪ussd:trx-sysmocell5000↪assert_extension.py:17] 10:20:57.178033 tst assert_extension.py:17: Test FAILED (5.8 sec) 10:20:57.203803 run osmo-hlr_10.42.42.2(pid=7584): ERR: Terminated: ERROR {rc=237} [trial-2403↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7584)] 10:20:57.251810 run osmo-hlr_10.42.42.2(pid=7584): stdout: | (launched: 2022-12-14_10:20:54.368405) 10:20:57.301370 run osmo-hlr_10.42.42.2(pid=7584): stderr: | 20221214102054559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102054559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102054559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102054559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102054559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102054559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102054572 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102054581 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102054582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102054582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:57.370560 run osmo-msc_10.42.42.6(pid=7590): ERR: Terminated: ERROR {rc=2} [trial-2403↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7590)] 10:20:57.417500 run osmo-msc_10.42.42.6(pid=7590): stdout: | (launched: 2022-12-14_10:20:56.341632) 10:20:57.466730 run osmo-msc_10.42.42.6(pid=7590): stderr: | 20221214102056607 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102056607 DLGLOBAL DEBUG validating counter group 0x7fa501bd8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102056608 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102056608 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102056608 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102056608 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102056610 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102056610 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102056610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102056610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:20:57.516333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7583): Terminating (SIGTERM) 10:20:57.556029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7586): Terminating (SIGTERM) 10:20:57.595490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7589): Terminating (SIGTERM) 10:20:57.635080 --- ParallelTerminationStrategy: PID 7583 died... 10:20:57.654422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7583): Terminated: ok {rc=0} 10:20:57.698139 --- ParallelTerminationStrategy: PID 7586 died... 10:20:57.716632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7586): Terminated: ok {rc=0} 10:20:57.760088 --- ParallelTerminationStrategy: PID 7589 died... 10:20:57.778639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7589): Terminated: ok {rc=0} 10:20:57.861287 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:20:59.076483 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:20:59.084066 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:20:59.118962 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:20:59.145768 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:20:59.198008 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:20:59.230956 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:20:59.258023 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:20:59.808178 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:20:59.857284 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:20:59.868434 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:20:59.937841 tst mo_mt_call.py: using LAC 40257 10:21:00.051525 tst mo_mt_call.py: using RAC 222 10:21:00.165125 tst mo_mt_call.py: using CellId 40257 10:21:00.278358 tst mo_mt_call.py: using BVCI 40258 10:21:00.385065 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:21:00.396136 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:21:00.407135 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:21:00.418245 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:21:00.430271 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:21:00.442151 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:21:00.561303 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:21:00.676849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:01.179635 run create_hlr_db(pid=7595): Launched 10:21:01.347429 bus /sierra_2: Setting Powered False 10:21:02.409176 run create_hlr_db(pid=7595): Terminated: ok {rc=0} 10:21:02.846787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7597): Launched 10:21:03.140119 run osmo-hlr_10.42.42.2(pid=7598): Launched 10:21:03.252237 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:03.753715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7600): Launched 10:21:04.046027 run osmo-stp_10.42.42.5(pid=7601): Launched 10:21:04.157313 run osmo-msc_10.42.42.6: Starting osmo-msc 10:21:04.686262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7603): Launched 10:21:04.979513 run osmo-msc_10.42.42.6(pid=7604): Launched 10:21:05.143100 run osmo-stp_10.42.42.5(pid=7601): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7601)] 10:21:05.267963 run osmo-stp_10.42.42.5(pid=7601): stdout: | (launched: 2022-12-14_10:21:03.992694) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:05.392494 run osmo-stp_10.42.42.5(pid=7601): stderr: | 20221214102104156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102104156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102104157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102104157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102104158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102104158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102104158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:05.515272 run osmo-stp_10.42.42.5(pid=7601): stdout: | (launched: 2022-12-14_10:21:03.992694) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:05.632074 run osmo-stp_10.42.42.5(pid=7601): stderr: | 20221214102104156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102104156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102104157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102104157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102104158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102104158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102104158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:05.772155 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7601): Process ended prematurely: osmo-stp_10.42.42.5(pid=7601) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7601)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:21:05.781224 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:21:05.807547 run osmo-hlr_10.42.42.2(pid=7598): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7598)] 10:21:05.855491 run osmo-hlr_10.42.42.2(pid=7598): stdout: | (launched: 2022-12-14_10:21:03.086170) 10:21:05.905372 run osmo-hlr_10.42.42.2(pid=7598): stderr: | 20221214102103257 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102103257 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102103257 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102103257 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102103257 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102103257 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102103299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102103309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102103309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102103309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:05.974433 run osmo-msc_10.42.42.6(pid=7604): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7604)] 10:21:06.021677 run osmo-msc_10.42.42.6(pid=7604): stdout: | (launched: 2022-12-14_10:21:04.925974) 10:21:06.070835 run osmo-msc_10.42.42.6(pid=7604): stderr: | 20221214102105193 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102105193 DLGLOBAL DEBUG validating counter group 0x7fb7bd73dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102105193 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102105193 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102105195 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102105195 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102105196 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102105197 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102105197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102105197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:21:06.120318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7597): Terminating (SIGTERM) 10:21:06.160124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7600): Terminating (SIGTERM) 10:21:06.199961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7603): Terminating (SIGTERM) 10:21:06.239918 --- ParallelTerminationStrategy: PID 7597 died... 10:21:06.259139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7597): Terminated: ok {rc=0} 10:21:06.303170 --- ParallelTerminationStrategy: PID 7600 died... 10:21:06.321808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7600): Terminated: ok {rc=0} 10:21:06.365400 --- ParallelTerminationStrategy: PID 7603 died... 10:21:06.384118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7603): Terminated: ok {rc=0} 10:21:06.467942 bus /sierra_3: Setting Powered False 10:21:07.565300 bus /sierra_3: Setting Powered False 10:21:08.682929 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:21:09.827104 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:21:09.838894 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:21:09.909090 tst mo_mt_call_osmux.py: using LAC 40258 10:21:10.029029 tst mo_mt_call_osmux.py: using RAC 223 10:21:10.152898 tst mo_mt_call_osmux.py: using CellId 40258 10:21:10.275707 tst mo_mt_call_osmux.py: using BVCI 40259 10:21:10.390992 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:21:10.402831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:21:10.414596 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:21:10.426257 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:21:10.438412 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:21:10.450064 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:21:10.565414 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:21:10.683043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:11.167167 run create_hlr_db(pid=7606): Launched 10:21:11.294857 bus /sierra_2: Setting Powered False 10:21:12.357181 run create_hlr_db(pid=7606): Terminated: ok {rc=0} 10:21:12.794444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7608): Launched 10:21:13.107603 run osmo-hlr_10.42.42.2(pid=7609): Launched 10:21:13.225918 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:13.768029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7611): Launched 10:21:14.082309 run osmo-stp_10.42.42.5(pid=7612): Launched 10:21:14.201124 run osmo-msc_10.42.42.6: Starting osmo-msc 10:21:14.767003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7614): Launched 10:21:15.080022 run osmo-msc_10.42.42.6(pid=7615): Launched 10:21:15.253943 run osmo-stp_10.42.42.5(pid=7612): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7612)] 10:21:15.385269 run osmo-stp_10.42.42.5(pid=7612): stdout: | (launched: 2022-12-14_10:21:14.025469) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:15.518297 run osmo-stp_10.42.42.5(pid=7612): stderr: | 20221214102114211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102114211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102114211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102114211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102114212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102114212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102114212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:15.650373 run osmo-stp_10.42.42.5(pid=7612): stdout: | (launched: 2022-12-14_10:21:14.025469) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:15.774388 run osmo-stp_10.42.42.5(pid=7612): stderr: | 20221214102114211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102114211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102114211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102114211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102114212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102114212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102114212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:15.931227 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7612): Process ended prematurely: osmo-stp_10.42.42.5(pid=7612) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7612)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:21:15.941660 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:21:15.969951 run osmo-hlr_10.42.42.2(pid=7609): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7609)] 10:21:16.020932 run osmo-hlr_10.42.42.2(pid=7609): stdout: | (launched: 2022-12-14_10:21:13.050751) 10:21:16.073470 run osmo-hlr_10.42.42.2(pid=7609): stderr: | 20221214102113243 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102113243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102113243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102113243 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102113243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102113243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102113256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102113264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102113264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102113264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:16.147121 run osmo-msc_10.42.42.6(pid=7615): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7615)] 10:21:16.198204 run osmo-msc_10.42.42.6(pid=7615): stdout: | (launched: 2022-12-14_10:21:15.023070) 10:21:16.250580 run osmo-msc_10.42.42.6(pid=7615): stderr: | 20221214102115341 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102115341 DLGLOBAL DEBUG validating counter group 0x7fddc0627c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102115342 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102115342 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102115342 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102115342 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102115344 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102115344 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102115344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102115344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:21:16.303287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7608): Terminating (SIGTERM) 10:21:16.346176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7611): Terminating (SIGTERM) 10:21:16.390753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7614): Terminating (SIGTERM) 10:21:16.434870 --- ParallelTerminationStrategy: PID 7608 died... 10:21:16.455736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7608): Terminated: ok {rc=0} 10:21:16.502807 --- ParallelTerminationStrategy: PID 7611 died... 10:21:16.523114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7611): Terminated: ok {rc=0} 10:21:16.569943 --- ParallelTerminationStrategy: PID 7614 died... 10:21:16.590428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7614): Terminated: ok {rc=0} 10:21:16.679942 bus /sierra_3: Setting Powered False 10:21:17.774005 bus /sierra_3: Setting Powered False 10:21:18.890415 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:21:20.136821 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:21:20.144889 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:21:20.179418 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:21:20.206825 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:21:20.259427 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:21:20.293713 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:21:20.321268 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:21:20.873996 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:21:20.922689 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:21:20.933982 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:21:21.003028 tst mo_mt_call.py: using LAC 40259 10:21:21.117939 tst mo_mt_call.py: using RAC 224 10:21:21.233184 tst mo_mt_call.py: using CellId 40259 10:21:21.349359 tst mo_mt_call.py: using BVCI 40260 10:21:21.457379 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:21:21.468363 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:21:21.479316 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:21:21.490343 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:21:21.501602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:21:21.512629 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:21:21.631235 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:21:21.745588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:22.198874 run create_hlr_db(pid=7620): Launched 10:21:22.328325 bus /sierra_2: Setting Powered False 10:21:23.390530 run create_hlr_db(pid=7620): Terminated: ok {rc=0} 10:21:23.826859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7622): Launched 10:21:24.140496 run osmo-hlr_10.42.42.2(pid=7623): Launched 10:21:24.259084 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:24.795595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7625): Launched 10:21:25.108859 run osmo-stp_10.42.42.5(pid=7626): Launched 10:21:25.227525 run osmo-msc_10.42.42.6: Starting osmo-msc 10:21:25.802539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7628): Launched 10:21:26.118479 run osmo-msc_10.42.42.6(pid=7629): Launched 10:21:26.293713 run osmo-stp_10.42.42.5(pid=7626): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7626)] 10:21:26.426372 run osmo-stp_10.42.42.5(pid=7626): stdout: | (launched: 2022-12-14_10:21:25.051576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:26.560757 run osmo-stp_10.42.42.5(pid=7626): stderr: | 20221214102125238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102125238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102125239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102125239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102125240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102125240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102125240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:26.693766 run osmo-stp_10.42.42.5(pid=7626): stdout: | (launched: 2022-12-14_10:21:25.051576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:26.819183 run osmo-stp_10.42.42.5(pid=7626): stderr: | 20221214102125238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102125238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102125239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102125239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102125240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102125240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102125240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:26.969257 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7626): Process ended prematurely: osmo-stp_10.42.42.5(pid=7626) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7626)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:21:26.978952 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:21:27.007160 run osmo-hlr_10.42.42.2(pid=7623): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7623)] 10:21:27.057375 run osmo-hlr_10.42.42.2(pid=7623): stdout: | (launched: 2022-12-14_10:21:24.083186) 10:21:27.109141 run osmo-hlr_10.42.42.2(pid=7623): stderr: | 20221214102124276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102124276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102124276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102124276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102124276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102124276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102124290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102124298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102124298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102124298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:27.181308 run osmo-msc_10.42.42.6(pid=7629): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7629)] 10:21:27.231101 run osmo-msc_10.42.42.6(pid=7629): stdout: | (launched: 2022-12-14_10:21:26.060747) 10:21:27.282739 run osmo-msc_10.42.42.6(pid=7629): stderr: | 20221214102126378 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102126378 DLGLOBAL DEBUG validating counter group 0x7f4a63809c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102126378 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102126379 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102126379 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102126379 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102126381 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102126381 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102126381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102126381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:21:27.335160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7622): Terminating (SIGTERM) 10:21:27.376743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7625): Terminating (SIGTERM) 10:21:27.418282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7628): Terminating (SIGTERM) 10:21:27.460594 --- ParallelTerminationStrategy: PID 7622 died... 10:21:27.480568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7622): Terminated: ok {rc=0} 10:21:27.526820 --- ParallelTerminationStrategy: PID 7625 died... 10:21:27.546356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7625): Terminated: ok {rc=0} 10:21:27.591721 --- ParallelTerminationStrategy: PID 7628 died... 10:21:27.611406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7628): Terminated: ok {rc=0} 10:21:27.698560 bus /sierra_3: Setting Powered False 10:21:28.797045 bus /sierra_3: Setting Powered False 10:21:29.910901 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:21:31.060529 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:21:31.073758 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:21:31.147108 tst mo_mt_call_osmux.py: using LAC 40260 10:21:31.272933 tst mo_mt_call_osmux.py: using RAC 225 10:21:31.399261 tst mo_mt_call_osmux.py: using CellId 40260 10:21:31.518888 tst mo_mt_call_osmux.py: using BVCI 40261 10:21:31.644171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:21:31.656544 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:21:31.669213 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:21:31.681789 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:21:31.694212 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:21:31.706727 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:21:31.826508 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:21:31.983951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:32.455062 run create_hlr_db(pid=7631): Launched 10:21:32.568057 bus /sierra_2: Setting Powered False 10:21:33.627629 run create_hlr_db(pid=7631): Terminated: ok {rc=0} 10:21:34.058689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7633): Launched 10:21:34.374086 run osmo-hlr_10.42.42.2(pid=7634): Launched 10:21:34.493402 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:35.034515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7636): Launched 10:21:35.350347 run osmo-stp_10.42.42.5(pid=7637): Launched 10:21:35.470116 run osmo-msc_10.42.42.6: Starting osmo-msc 10:21:36.040541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7639): Launched 10:21:36.355715 run osmo-msc_10.42.42.6(pid=7640): Launched 10:21:36.531645 run osmo-stp_10.42.42.5(pid=7637): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7637)] 10:21:36.663898 run osmo-stp_10.42.42.5(pid=7637): stdout: | (launched: 2022-12-14_10:21:35.292593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:36.797382 run osmo-stp_10.42.42.5(pid=7637): stderr: | 20221214102135479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102135479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102135479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102135480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102135480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102135480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102135480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:36.929278 run osmo-stp_10.42.42.5(pid=7637): stdout: | (launched: 2022-12-14_10:21:35.292593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:37.054205 run osmo-stp_10.42.42.5(pid=7637): stderr: | 20221214102135479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102135479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102135479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102135480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102135480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102135480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102135480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:37.203882 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7637): Process ended prematurely: osmo-stp_10.42.42.5(pid=7637) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7637)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:21:37.213812 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:21:37.241463 run osmo-hlr_10.42.42.2(pid=7634): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7634)] 10:21:37.291417 run osmo-hlr_10.42.42.2(pid=7634): stdout: | (launched: 2022-12-14_10:21:34.316513) 10:21:37.343006 run osmo-hlr_10.42.42.2(pid=7634): stderr: | 20221214102134508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102134508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102134508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102134508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102134508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102134508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102134521 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102134529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102134529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102134529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:37.414593 run osmo-msc_10.42.42.6(pid=7640): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7640)] 10:21:37.464291 run osmo-msc_10.42.42.6(pid=7640): stdout: | (launched: 2022-12-14_10:21:36.298112) 10:21:37.515629 run osmo-msc_10.42.42.6(pid=7640): stderr: | 20221214102136614 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102136615 DLGLOBAL DEBUG validating counter group 0x7fa47dc87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102136615 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102136615 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102136615 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102136615 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102136617 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102136617 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102136618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102136618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:21:37.567163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7633): Terminating (SIGTERM) 10:21:37.608472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7636): Terminating (SIGTERM) 10:21:37.650155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7639): Terminating (SIGTERM) 10:21:37.692204 --- ParallelTerminationStrategy: PID 7633 died... 10:21:37.712279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7633): Terminated: ok {rc=0} 10:21:37.757795 --- ParallelTerminationStrategy: PID 7636 died... 10:21:37.777148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7636): Terminated: ok {rc=0} 10:21:37.822505 --- ParallelTerminationStrategy: PID 7639 died... 10:21:37.841816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7639): Terminated: ok {rc=0} 10:21:37.928656 bus /sierra_3: Setting Powered False 10:21:39.025879 bus /sierra_3: Setting Powered False 10:21:40.139838 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:21:41.391795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:21:41.398993 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:21:41.433629 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:21:41.461446 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:21:41.515286 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:21:41.548486 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:21:41.575044 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:21:42.125038 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:21:42.172766 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:21:42.184116 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:21:42.254562 tst mo_mt_call.py: using LAC 40261 10:21:42.378376 tst mo_mt_call.py: using RAC 226 10:21:42.503560 tst mo_mt_call.py: using CellId 40261 10:21:42.629180 tst mo_mt_call.py: using BVCI 40262 10:21:42.744185 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:21:42.755982 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:21:42.767302 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:21:42.778649 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:21:42.790119 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:21:42.801547 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:21:42.917703 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:21:43.035185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:43.523185 run create_hlr_db(pid=7645): Launched 10:21:43.651237 bus /sierra_2: Setting Powered False 10:21:44.714114 run create_hlr_db(pid=7645): Terminated: ok {rc=0} 10:21:45.152488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7647): Launched 10:21:45.466814 run osmo-hlr_10.42.42.2(pid=7648): Launched 10:21:45.586701 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:46.129757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7650): Launched 10:21:46.453775 run osmo-stp_10.42.42.5(pid=7651): Launched 10:21:46.705616 run osmo-msc_10.42.42.6: Starting osmo-msc 10:21:47.335024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7653): Launched 10:21:47.630379 run osmo-msc_10.42.42.6(pid=7654): Launched 10:21:47.796046 run osmo-stp_10.42.42.5(pid=7651): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7651)] 10:21:47.920423 run osmo-stp_10.42.42.5(pid=7651): stdout: | (launched: 2022-12-14_10:21:46.390911) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:48.045787 run osmo-stp_10.42.42.5(pid=7651): stderr: | 20221214102146654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102146654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102146654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102146654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102146655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102146655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102146655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:48.169814 run osmo-stp_10.42.42.5(pid=7651): stdout: | (launched: 2022-12-14_10:21:46.390911) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:48.287097 run osmo-stp_10.42.42.5(pid=7651): stderr: | 20221214102146654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102146654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102146654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102146654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102146655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102146655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102146655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:48.428740 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7651): Process ended prematurely: osmo-stp_10.42.42.5(pid=7651) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7651)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:21:48.437857 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:21:48.463813 run osmo-hlr_10.42.42.2(pid=7648): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7648)] 10:21:48.511246 run osmo-hlr_10.42.42.2(pid=7648): stdout: | (launched: 2022-12-14_10:21:45.409344) 10:21:48.560311 run osmo-hlr_10.42.42.2(pid=7648): stderr: | 20221214102145602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102145602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102145602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102145602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102145602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102145602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102145617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102145625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102145625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102145625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:48.629081 run osmo-msc_10.42.42.6(pid=7654): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7654)] 10:21:48.676102 run osmo-msc_10.42.42.6(pid=7654): stdout: | (launched: 2022-12-14_10:21:47.576392) 10:21:48.725050 run osmo-msc_10.42.42.6(pid=7654): stderr: | 20221214102147844 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102147844 DLGLOBAL DEBUG validating counter group 0x7fea640dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102147844 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102147844 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102147844 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102147844 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102147846 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102147846 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102147847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102147847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:21:48.774142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7647): Terminating (SIGTERM) 10:21:48.813571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7650): Terminating (SIGTERM) 10:21:48.852808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7653): Terminating (SIGTERM) 10:21:48.892389 --- ParallelTerminationStrategy: PID 7647 died... 10:21:48.911557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7647): Terminated: ok {rc=0} 10:21:48.955065 --- ParallelTerminationStrategy: PID 7650 died... 10:21:48.973575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7650): Terminated: ok {rc=0} 10:21:49.016820 --- ParallelTerminationStrategy: PID 7653 died... 10:21:49.035738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7653): Terminated: ok {rc=0} 10:21:49.121573 bus /sierra_3: Setting Powered False 10:21:50.219524 bus /sierra_3: Setting Powered False 10:21:51.335367 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:21:52.481780 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:21:52.494087 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:21:52.566367 tst mo_mt_call_osmux.py: using LAC 40262 10:21:52.691661 tst mo_mt_call_osmux.py: using RAC 227 10:21:52.816686 tst mo_mt_call_osmux.py: using CellId 40262 10:21:52.940136 tst mo_mt_call_osmux.py: using BVCI 40263 10:21:53.048182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:21:53.059565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:21:53.070735 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:21:53.081873 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:21:53.093561 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:21:53.104874 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:21:53.222734 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:21:53.338447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:53.795809 run create_hlr_db(pid=7656): Launched 10:21:53.908870 bus /sierra_2: Setting Powered False 10:21:54.968344 run create_hlr_db(pid=7656): Terminated: ok {rc=0} 10:21:55.401748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7658): Launched 10:21:55.717577 run osmo-hlr_10.42.42.2(pid=7659): Launched 10:21:55.837795 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:56.384675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7661): Launched 10:21:56.699984 run osmo-stp_10.42.42.5(pid=7662): Launched 10:21:56.818784 run osmo-msc_10.42.42.6: Starting osmo-msc 10:21:57.387292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7664): Launched 10:21:57.702960 run osmo-msc_10.42.42.6(pid=7665): Launched 10:21:57.878890 run osmo-stp_10.42.42.5(pid=7662): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7662)] 10:21:58.011465 run osmo-stp_10.42.42.5(pid=7662): stdout: | (launched: 2022-12-14_10:21:56.642478) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:58.145251 run osmo-stp_10.42.42.5(pid=7662): stderr: | 20221214102156830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102156830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102156830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102156831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102156831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102156831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102156831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:58.277356 run osmo-stp_10.42.42.5(pid=7662): stdout: | (launched: 2022-12-14_10:21:56.642478) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:58.402516 run osmo-stp_10.42.42.5(pid=7662): stderr: | 20221214102156830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102156830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102156830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102156831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102156831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102156831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102156831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:58.552844 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7662): Process ended prematurely: osmo-stp_10.42.42.5(pid=7662) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7662)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:21:58.562544 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:21:58.590074 run osmo-hlr_10.42.42.2(pid=7659): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7659)] 10:21:58.639915 run osmo-hlr_10.42.42.2(pid=7659): stdout: | (launched: 2022-12-14_10:21:55.660073) 10:21:58.691760 run osmo-hlr_10.42.42.2(pid=7659): stderr: | 20221214102155854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102155854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102155854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102155854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102155854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102155854 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102155866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102155874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102155874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102155874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:58.763690 run osmo-msc_10.42.42.6(pid=7665): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7665)] 10:21:58.813252 run osmo-msc_10.42.42.6(pid=7665): stdout: | (launched: 2022-12-14_10:21:57.645432) 10:21:58.864442 run osmo-msc_10.42.42.6(pid=7665): stderr: | 20221214102157961 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102157961 DLGLOBAL DEBUG validating counter group 0x7effe3812c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102157961 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102157961 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102157961 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102157962 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102157963 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102157964 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102157964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102157964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:21:58.916085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7658): Terminating (SIGTERM) 10:21:58.957412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7661): Terminating (SIGTERM) 10:21:58.998806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7664): Terminating (SIGTERM) 10:21:59.040353 --- ParallelTerminationStrategy: PID 7658 died... 10:21:59.059834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7658): Terminated: ok {rc=0} 10:21:59.105292 --- ParallelTerminationStrategy: PID 7661 died... 10:21:59.124364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7661): Terminated: ok {rc=0} 10:21:59.169687 --- ParallelTerminationStrategy: PID 7664 died... 10:21:59.188907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7664): Terminated: ok {rc=0} 10:21:59.276070 bus /sierra_3: Setting Powered False 10:22:00.373419 bus /sierra_3: Setting Powered False 10:22:01.489216 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:22:02.741799 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:22:02.750791 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:22:02.785589 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:22:02.812644 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:22:02.863808 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:22:02.896780 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:22:02.923431 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:22:03.485297 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:22:03.535689 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:22:03.547357 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:22:03.617200 tst mo_mt_call.py: using LAC 40263 10:22:03.739141 tst mo_mt_call.py: using RAC 228 10:22:03.860444 tst mo_mt_call.py: using CellId 40263 10:22:03.982675 tst mo_mt_call.py: using BVCI 40264 10:22:04.096556 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:22:04.108185 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:22:04.119705 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:22:04.131072 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:22:04.142581 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:22:04.153930 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:22:04.270170 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:22:04.389518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:04.876329 run create_hlr_db(pid=7672): Launched 10:22:05.003573 bus /sierra_2: Setting Powered False 10:22:06.066927 run create_hlr_db(pid=7672): Terminated: ok {rc=0} 10:22:06.489581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7674): Launched 10:22:06.785372 run osmo-hlr_10.42.42.2(pid=7675): Launched 10:22:06.897503 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:07.418597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7677): Launched 10:22:07.713469 run osmo-stp_10.42.42.5(pid=7678): Launched 10:22:07.825469 run osmo-msc_10.42.42.6: Starting osmo-msc 10:22:08.372122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7680): Launched 10:22:08.669696 run osmo-msc_10.42.42.6(pid=7681): Launched 10:22:08.835705 run osmo-stp_10.42.42.5(pid=7678): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7678)] 10:22:08.961895 run osmo-stp_10.42.42.5(pid=7678): stdout: | (launched: 2022-12-14_10:22:07.658859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:09.087798 run osmo-stp_10.42.42.5(pid=7678): stderr: | 20221214102207826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102207826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102207826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102207827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102207827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102207827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102207827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:09.211821 run osmo-stp_10.42.42.5(pid=7678): stdout: | (launched: 2022-12-14_10:22:07.658859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:09.329376 run osmo-stp_10.42.42.5(pid=7678): stderr: | 20221214102207826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102207826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102207826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102207827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102207827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102207827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102207827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:09.470321 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7678): Process ended prematurely: osmo-stp_10.42.42.5(pid=7678) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7678)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:22:09.479137 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:22:09.505173 run osmo-hlr_10.42.42.2(pid=7675): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7675)] 10:22:09.553376 run osmo-hlr_10.42.42.2(pid=7675): stdout: | (launched: 2022-12-14_10:22:06.730887) 10:22:09.602489 run osmo-hlr_10.42.42.2(pid=7675): stderr: | 20221214102206902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102206902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102206902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102206902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102206902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102206902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102206914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102206923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102206923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102206923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:09.671414 run osmo-msc_10.42.42.6(pid=7681): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7681)] 10:22:09.718518 run osmo-msc_10.42.42.6(pid=7681): stdout: | (launched: 2022-12-14_10:22:08.614717) 10:22:09.767582 run osmo-msc_10.42.42.6(pid=7681): stderr: | 20221214102208881 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102208881 DLGLOBAL DEBUG validating counter group 0x7fbf6ee4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102208881 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102208881 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102208881 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102208882 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102208883 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102208884 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102208884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102208884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:22:09.817050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7674): Terminating (SIGTERM) 10:22:09.856374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7677): Terminating (SIGTERM) 10:22:09.895782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7680): Terminating (SIGTERM) 10:22:09.936138 --- ParallelTerminationStrategy: PID 7674 died... 10:22:09.955563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7674): Terminated: ok {rc=0} 10:22:09.999417 --- ParallelTerminationStrategy: PID 7677 died... 10:22:10.017997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7677): Terminated: ok {rc=0} 10:22:10.061489 --- ParallelTerminationStrategy: PID 7680 died... 10:22:10.080095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7680): Terminated: ok {rc=0} 10:22:10.165010 bus /sierra_3: Setting Powered False 10:22:11.263675 bus /sierra_3: Setting Powered False 10:22:12.377562 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:22:13.521609 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:22:13.533177 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:22:13.602547 tst mo_mt_call_osmux.py: using LAC 40264 10:22:13.718538 tst mo_mt_call_osmux.py: using RAC 229 10:22:13.835322 tst mo_mt_call_osmux.py: using CellId 40264 10:22:13.952356 tst mo_mt_call_osmux.py: using BVCI 40265 10:22:14.059826 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:22:14.070970 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:22:14.081834 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:22:14.092819 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:22:14.104093 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:22:14.115287 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:22:14.228785 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:22:14.347457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:14.803908 run create_hlr_db(pid=7683): Launched 10:22:14.916224 bus /sierra_2: Setting Powered False 10:22:15.975819 run create_hlr_db(pid=7683): Terminated: ok {rc=0} 10:22:16.402149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7685): Launched 10:22:16.749746 run osmo-hlr_10.42.42.2(pid=7686): Launched 10:22:16.985559 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:17.590954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7688): Launched 10:22:17.907332 run osmo-stp_10.42.42.5(pid=7689): Launched 10:22:18.027293 run osmo-msc_10.42.42.6: Starting osmo-msc 10:22:18.597692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7691): Launched 10:22:18.913338 run osmo-msc_10.42.42.6(pid=7692): Launched 10:22:19.088771 run osmo-stp_10.42.42.5(pid=7689): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7689)] 10:22:19.222003 run osmo-stp_10.42.42.5(pid=7689): stdout: | (launched: 2022-12-14_10:22:17.849811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:19.355266 run osmo-stp_10.42.42.5(pid=7689): stderr: | 20221214102218038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102218038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102218038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102218038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102218039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102218039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102218039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:19.488745 run osmo-stp_10.42.42.5(pid=7689): stdout: | (launched: 2022-12-14_10:22:17.849811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:19.614189 run osmo-stp_10.42.42.5(pid=7689): stderr: | 20221214102218038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102218038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102218038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102218038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102218039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102218039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102218039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:19.763998 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7689): Process ended prematurely: osmo-stp_10.42.42.5(pid=7689) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7689)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:22:19.773972 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:22:19.801602 run osmo-hlr_10.42.42.2(pid=7686): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7686)] 10:22:19.851482 run osmo-hlr_10.42.42.2(pid=7686): stdout: | (launched: 2022-12-14_10:22:16.683362) 10:22:19.903329 run osmo-hlr_10.42.42.2(pid=7686): stderr: | 20221214102216921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102216921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102216921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102216921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102216921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102216921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102216939 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102216947 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102216947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102216947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:19.975219 run osmo-msc_10.42.42.6(pid=7692): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7692)] 10:22:20.025162 run osmo-msc_10.42.42.6(pid=7692): stdout: | (launched: 2022-12-14_10:22:18.855463) 10:22:20.077155 run osmo-msc_10.42.42.6(pid=7692): stderr: | 20221214102219171 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102219171 DLGLOBAL DEBUG validating counter group 0x7ffa32026c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102219171 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102219171 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102219172 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102219172 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102219173 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102219174 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102219174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102219174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:22:20.129290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7685): Terminating (SIGTERM) 10:22:20.170799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7688): Terminating (SIGTERM) 10:22:20.213048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7691): Terminating (SIGTERM) 10:22:20.254748 --- ParallelTerminationStrategy: PID 7685 died... 10:22:20.274851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7685): Terminated: ok {rc=0} 10:22:20.320559 --- ParallelTerminationStrategy: PID 7688 died... 10:22:20.340024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7688): Terminated: ok {rc=0} 10:22:20.386011 --- ParallelTerminationStrategy: PID 7691 died... 10:22:20.405467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7691): Terminated: ok {rc=0} 10:22:20.492625 bus /sierra_3: Setting Powered False 10:22:21.590956 bus /sierra_3: Setting Powered False 10:22:22.705710 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:22:23.953824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:22:23.960070 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:22:23.992729 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:22:24.020334 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:22:24.072250 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:22:24.107122 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:22:24.134695 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:22:24.682021 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:22:24.730572 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:22:24.741867 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:22:24.810158 tst mo_mt_call.py: using LAC 40265 10:22:24.927845 tst mo_mt_call.py: using RAC 230 10:22:25.046012 tst mo_mt_call.py: using CellId 40265 10:22:25.161270 tst mo_mt_call.py: using BVCI 40266 10:22:25.269215 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:22:25.280170 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:22:25.291039 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:22:25.301981 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:22:25.313333 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:22:25.324463 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:22:25.439891 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:22:25.558189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:26.046008 run create_hlr_db(pid=7697): Launched 10:22:26.174818 bus /sierra_2: Setting Powered False 10:22:27.237211 run create_hlr_db(pid=7697): Terminated: ok {rc=0} 10:22:27.678082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7699): Launched 10:22:27.992126 run osmo-hlr_10.42.42.2(pid=7700): Launched 10:22:28.112039 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:28.655849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7702): Launched 10:22:28.969979 run osmo-stp_10.42.42.5(pid=7703): Launched 10:22:29.089135 run osmo-msc_10.42.42.6: Starting osmo-msc 10:22:29.658019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7705): Launched 10:22:29.972248 run osmo-msc_10.42.42.6(pid=7706): Launched 10:22:30.148727 run osmo-stp_10.42.42.5(pid=7703): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7703)] 10:22:30.281362 run osmo-stp_10.42.42.5(pid=7703): stdout: | (launched: 2022-12-14_10:22:28.912705) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:30.415193 run osmo-stp_10.42.42.5(pid=7703): stderr: | 20221214102229100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102229100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102229101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102229101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102229101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102229102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102229102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:30.548126 run osmo-stp_10.42.42.5(pid=7703): stdout: | (launched: 2022-12-14_10:22:28.912705) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:30.672903 run osmo-stp_10.42.42.5(pid=7703): stderr: | 20221214102229100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102229100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102229101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102229101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102229101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102229102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102229102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:30.822644 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7703): Process ended prematurely: osmo-stp_10.42.42.5(pid=7703) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7703)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:22:30.832455 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:22:30.869724 run osmo-hlr_10.42.42.2(pid=7700): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7700)] 10:22:30.920534 run osmo-hlr_10.42.42.2(pid=7700): stdout: | (launched: 2022-12-14_10:22:27.934941) 10:22:30.973283 run osmo-hlr_10.42.42.2(pid=7700): stderr: | 20221214102228129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102228129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102228129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102228129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102228129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102228129 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102228142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102228150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102228150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102228151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:31.046305 run osmo-msc_10.42.42.6(pid=7706): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7706)] 10:22:31.097132 run osmo-msc_10.42.42.6(pid=7706): stdout: | (launched: 2022-12-14_10:22:29.914769) 10:22:31.149721 run osmo-msc_10.42.42.6(pid=7706): stderr: | 20221214102230231 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102230231 DLGLOBAL DEBUG validating counter group 0x7f8c61507c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102230231 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102230231 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102230231 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102230232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102230233 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102230234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102230234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102230234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:22:31.203001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7699): Terminating (SIGTERM) 10:22:31.245789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7702): Terminating (SIGTERM) 10:22:31.289927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7705): Terminating (SIGTERM) 10:22:31.333175 --- ParallelTerminationStrategy: PID 7699 died... 10:22:31.353971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7699): Terminated: ok {rc=0} 10:22:31.401599 --- ParallelTerminationStrategy: PID 7702 died... 10:22:31.421633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7702): Terminated: ok {rc=0} 10:22:31.467929 --- ParallelTerminationStrategy: PID 7705 died... 10:22:31.488387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7705): Terminated: ok {rc=0} 10:22:31.579390 bus /sierra_3: Setting Powered False 10:22:32.678837 bus /sierra_3: Setting Powered False 10:22:33.796084 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:22:34.940730 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:22:34.952500 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:22:35.023944 tst mo_mt_call_osmux.py: using LAC 40266 10:22:35.144804 tst mo_mt_call_osmux.py: using RAC 231 10:22:35.259037 tst mo_mt_call_osmux.py: using CellId 40266 10:22:35.373671 tst mo_mt_call_osmux.py: using BVCI 40267 10:22:35.491328 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:22:35.503217 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:22:35.514962 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:22:35.526676 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:22:35.539091 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:22:35.551290 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:22:35.669716 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:22:35.788863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:36.278278 run create_hlr_db(pid=7708): Launched 10:22:36.407598 bus /sierra_2: Setting Powered False 10:22:37.469809 run create_hlr_db(pid=7708): Terminated: ok {rc=0} 10:22:37.911228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7710): Launched 10:22:38.228276 run osmo-hlr_10.42.42.2(pid=7711): Launched 10:22:38.347988 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:38.893912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7713): Launched 10:22:39.209369 run osmo-stp_10.42.42.5(pid=7714): Launched 10:22:39.329558 run osmo-msc_10.42.42.6: Starting osmo-msc 10:22:39.900383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7716): Launched 10:22:40.217676 run osmo-msc_10.42.42.6(pid=7717): Launched 10:22:40.393564 run osmo-stp_10.42.42.5(pid=7714): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7714)] 10:22:40.526822 run osmo-stp_10.42.42.5(pid=7714): stdout: | (launched: 2022-12-14_10:22:39.151461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:40.661103 run osmo-stp_10.42.42.5(pid=7714): stderr: | 20221214102239338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102239338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102239338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102239339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102239339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102239339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102239339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:40.794485 run osmo-stp_10.42.42.5(pid=7714): stdout: | (launched: 2022-12-14_10:22:39.151461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:40.919890 run osmo-stp_10.42.42.5(pid=7714): stderr: | 20221214102239338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102239338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102239338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102239339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102239339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102239339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102239339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:41.070178 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7714): Process ended prematurely: osmo-stp_10.42.42.5(pid=7714) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7714)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:22:41.079997 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:22:41.107810 run osmo-hlr_10.42.42.2(pid=7711): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7711)] 10:22:41.157341 run osmo-hlr_10.42.42.2(pid=7711): stdout: | (launched: 2022-12-14_10:22:38.170256) 10:22:41.208583 run osmo-hlr_10.42.42.2(pid=7711): stderr: | 20221214102238365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102238365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102238365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102238365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102238365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102238365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102238378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102238386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102238386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102238387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:41.280036 run osmo-msc_10.42.42.6(pid=7717): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7717)] 10:22:41.329311 run osmo-msc_10.42.42.6(pid=7717): stdout: | (launched: 2022-12-14_10:22:40.159058) 10:22:41.380331 run osmo-msc_10.42.42.6(pid=7717): stderr: | 20221214102240477 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102240478 DLGLOBAL DEBUG validating counter group 0x7f003f172c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102240478 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102240478 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102240478 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102240478 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102240480 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102240480 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102240480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102240480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:22:41.431702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7710): Terminating (SIGTERM) 10:22:41.473376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7713): Terminating (SIGTERM) 10:22:41.515429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7716): Terminating (SIGTERM) 10:22:41.557536 --- ParallelTerminationStrategy: PID 7710 died... 10:22:41.577445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7710): Terminated: ok {rc=0} 10:22:41.623209 --- ParallelTerminationStrategy: PID 7713 died... 10:22:41.642625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7713): Terminated: ok {rc=0} 10:22:41.688311 --- ParallelTerminationStrategy: PID 7716 died... 10:22:41.707868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7716): Terminated: ok {rc=0} 10:22:41.794965 bus /sierra_3: Setting Powered False 10:22:42.893128 bus /sierra_3: Setting Powered False 10:22:44.010139 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:22:45.268036 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:22:45.275152 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:22:45.309536 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:22:45.336844 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:22:45.388124 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:22:45.422123 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:22:45.449163 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:22:46.008788 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:22:46.077402 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:22:46.093100 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:22:46.177328 tst mo_mt_call.py: using LAC 40267 10:22:46.296544 tst mo_mt_call.py: using RAC 232 10:22:46.442112 tst mo_mt_call.py: using CellId 40267 10:22:46.565474 tst mo_mt_call.py: using BVCI 40268 10:22:46.681407 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:22:46.695318 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:22:46.711097 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:22:46.726462 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:22:46.741672 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:22:46.756780 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:22:46.900846 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:22:47.052116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:47.530008 run create_hlr_db(pid=7722): Launched 10:22:47.644683 bus /sierra_2: Setting Powered False 10:22:48.704217 run create_hlr_db(pid=7722): Terminated: ok {rc=0} 10:22:49.135223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7724): Launched 10:22:49.436113 run osmo-hlr_10.42.42.2(pid=7725): Launched 10:22:49.548252 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:50.054046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7727): Launched 10:22:50.350945 run osmo-stp_10.42.42.5(pid=7728): Launched 10:22:50.464033 run osmo-msc_10.42.42.6: Starting osmo-msc 10:22:50.999511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7730): Launched 10:22:51.296856 run osmo-msc_10.42.42.6(pid=7731): Launched 10:22:51.462442 run osmo-stp_10.42.42.5(pid=7728): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7728)] 10:22:51.588611 run osmo-stp_10.42.42.5(pid=7728): stdout: | (launched: 2022-12-14_10:22:50.296645) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:51.715056 run osmo-stp_10.42.42.5(pid=7728): stderr: | 20221214102250462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102250462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102250463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102250463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102250464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102250464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102250464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:51.839173 run osmo-stp_10.42.42.5(pid=7728): stdout: | (launched: 2022-12-14_10:22:50.296645) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:51.958084 run osmo-stp_10.42.42.5(pid=7728): stderr: | 20221214102250462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102250462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102250463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102250463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102250464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102250464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102250464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:52.099195 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7728): Process ended prematurely: osmo-stp_10.42.42.5(pid=7728) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7728)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:22:52.108267 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:22:52.134193 run osmo-hlr_10.42.42.2(pid=7725): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7725)] 10:22:52.183176 run osmo-hlr_10.42.42.2(pid=7725): stdout: | (launched: 2022-12-14_10:22:49.381813) 10:22:52.232746 run osmo-hlr_10.42.42.2(pid=7725): stderr: | 20221214102249553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102249553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102249553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102249553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102249553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102249553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102249565 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102249574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102249575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102249575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:52.302920 run osmo-msc_10.42.42.6(pid=7731): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7731)] 10:22:52.349907 run osmo-msc_10.42.42.6(pid=7731): stdout: | (launched: 2022-12-14_10:22:51.242175) 10:22:52.399335 run osmo-msc_10.42.42.6(pid=7731): stderr: | 20221214102251510 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102251511 DLGLOBAL DEBUG validating counter group 0x7fc11966ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102251511 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102251511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102251511 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102251511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102251513 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102251513 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102251513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102251514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:22:52.449355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7724): Terminating (SIGTERM) 10:22:52.489960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7727): Terminating (SIGTERM) 10:22:52.530335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7730): Terminating (SIGTERM) 10:22:52.570577 --- ParallelTerminationStrategy: PID 7724 died... 10:22:52.590320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7724): Terminated: ok {rc=0} 10:22:52.634527 --- ParallelTerminationStrategy: PID 7727 died... 10:22:52.653680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7727): Terminated: ok {rc=0} 10:22:52.697540 --- ParallelTerminationStrategy: PID 7730 died... 10:22:52.716559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7730): Terminated: ok {rc=0} 10:22:52.802982 bus /sierra_3: Setting Powered False 10:22:53.901402 bus /sierra_3: Setting Powered False 10:22:55.015038 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:22:56.159244 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:22:56.171036 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:22:56.246573 tst mo_mt_call_osmux.py: using LAC 40268 10:22:56.366410 tst mo_mt_call_osmux.py: using RAC 233 10:22:56.481355 tst mo_mt_call_osmux.py: using CellId 40268 10:22:56.605442 tst mo_mt_call_osmux.py: using BVCI 40269 10:22:56.719685 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:22:56.731780 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:22:56.743456 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:22:56.755212 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:22:56.767212 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:22:56.779095 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:22:56.895074 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:22:57.015009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:57.503702 run create_hlr_db(pid=7733): Launched 10:22:57.633958 bus /sierra_2: Setting Powered False 10:22:58.697083 run create_hlr_db(pid=7733): Terminated: ok {rc=0} 10:22:59.138421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7735): Launched 10:22:59.454303 run osmo-hlr_10.42.42.2(pid=7736): Launched 10:22:59.575045 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:00.115653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7738): Launched 10:23:00.431664 run osmo-stp_10.42.42.5(pid=7739): Launched 10:23:00.552283 run osmo-msc_10.42.42.6: Starting osmo-msc 10:23:01.144546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7741): Launched 10:23:01.473745 run osmo-msc_10.42.42.6(pid=7742): Launched 10:23:01.819152 run osmo-stp_10.42.42.5(pid=7739): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7739)] 10:23:02.081855 run osmo-stp_10.42.42.5(pid=7739): stdout: | (launched: 2022-12-14_10:23:00.374001) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:02.240605 run osmo-stp_10.42.42.5(pid=7739): stderr: | 20221214102300560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102300560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102300560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102300561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102300561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102300561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102300561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:02.368433 run osmo-stp_10.42.42.5(pid=7739): stdout: | (launched: 2022-12-14_10:23:00.374001) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:02.486959 run osmo-stp_10.42.42.5(pid=7739): stderr: | 20221214102300560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102300560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102300560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102300561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102300561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102300561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102300561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:02.629264 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7739): Process ended prematurely: osmo-stp_10.42.42.5(pid=7739) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7739)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:23:02.638536 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:23:02.665256 run osmo-hlr_10.42.42.2(pid=7736): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7736)] 10:23:02.713954 run osmo-hlr_10.42.42.2(pid=7736): stdout: | (launched: 2022-12-14_10:22:59.396885) 10:23:02.763784 run osmo-hlr_10.42.42.2(pid=7736): stderr: | 20221214102259588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102259588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102259589 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102259589 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102259589 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102259589 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102259601 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102259609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102259609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102259609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:02.833575 run osmo-msc_10.42.42.6(pid=7742): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7742)] 10:23:02.881162 run osmo-msc_10.42.42.6(pid=7742): stdout: | (launched: 2022-12-14_10:23:01.409873) 10:23:02.930604 run osmo-msc_10.42.42.6(pid=7742): stderr: | 20221214102301994 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102301994 DLGLOBAL DEBUG validating counter group 0x7f5537c0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102301994 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102301994 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102301995 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102301995 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102301997 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102301997 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102301998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102301998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:23:02.980819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7735): Terminating (SIGTERM) 10:23:03.021092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7738): Terminating (SIGTERM) 10:23:03.061108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7741): Terminating (SIGTERM) 10:23:03.101520 --- ParallelTerminationStrategy: PID 7735 died... 10:23:03.121258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7735): Terminated: ok {rc=0} 10:23:03.165584 --- ParallelTerminationStrategy: PID 7738 died... 10:23:03.184595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7738): Terminated: ok {rc=0} 10:23:03.228680 --- ParallelTerminationStrategy: PID 7741 died... 10:23:03.247918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7741): Terminated: ok {rc=0} 10:23:03.333942 bus /sierra_3: Setting Powered False 10:23:04.432154 bus /sierra_3: Setting Powered False 10:23:05.546853 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:23:06.798138 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:06.804749 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:23:06.838899 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:23:06.866667 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:23:06.919273 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:23:06.952555 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:23:06.979355 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:23:07.532320 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:23:07.583015 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:23:07.594715 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:23:07.666759 tst mo_mt_call.py: using LAC 40269 10:23:07.792349 tst mo_mt_call.py: using RAC 234 10:23:07.910288 tst mo_mt_call.py: using CellId 40269 10:23:08.029385 tst mo_mt_call.py: using BVCI 40270 10:23:08.144523 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:23:08.156139 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:23:08.167834 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:23:08.179221 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:23:08.190820 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:23:08.202112 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:23:08.318093 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:23:08.433431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:08.922644 run create_hlr_db(pid=7747): Launched 10:23:09.050830 bus /sierra_2: Setting Powered False 10:23:10.112869 run create_hlr_db(pid=7747): Terminated: ok {rc=0} 10:23:10.552242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7749): Launched 10:23:10.866540 run osmo-hlr_10.42.42.2(pid=7750): Launched 10:23:10.986435 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:11.533390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7752): Launched 10:23:11.848303 run osmo-stp_10.42.42.5(pid=7753): Launched 10:23:11.968610 run osmo-msc_10.42.42.6: Starting osmo-msc 10:23:12.540018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7755): Launched 10:23:12.855904 run osmo-msc_10.42.42.6(pid=7756): Launched 10:23:13.033806 run osmo-stp_10.42.42.5(pid=7753): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7753)] 10:23:13.167071 run osmo-stp_10.42.42.5(pid=7753): stdout: | (launched: 2022-12-14_10:23:11.790813) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:13.300933 run osmo-stp_10.42.42.5(pid=7753): stderr: | 20221214102311978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102311978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102311978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102311979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102311979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102311979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102311979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:13.433897 run osmo-stp_10.42.42.5(pid=7753): stdout: | (launched: 2022-12-14_10:23:11.790813) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:13.560356 run osmo-stp_10.42.42.5(pid=7753): stderr: | 20221214102311978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102311978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102311978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102311979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102311979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102311979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102311979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:13.710439 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7753): Process ended prematurely: osmo-stp_10.42.42.5(pid=7753) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7753)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:23:13.719999 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:23:13.747702 run osmo-hlr_10.42.42.2(pid=7750): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7750)] 10:23:13.797352 run osmo-hlr_10.42.42.2(pid=7750): stdout: | (launched: 2022-12-14_10:23:10.809208) 10:23:13.848816 run osmo-hlr_10.42.42.2(pid=7750): stderr: | 20221214102311002 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102311002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102311002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102311002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102311002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102311003 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102311015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102311023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102311023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102311023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:13.920270 run osmo-msc_10.42.42.6(pid=7756): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7756)] 10:23:13.970091 run osmo-msc_10.42.42.6(pid=7756): stdout: | (launched: 2022-12-14_10:23:12.798178) 10:23:14.021600 run osmo-msc_10.42.42.6(pid=7756): stderr: | 20221214102313115 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102313115 DLGLOBAL DEBUG validating counter group 0x7f37eb423c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102313115 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102313115 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102313115 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102313115 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102313117 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102313118 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102313118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102313118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:23:14.073371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7749): Terminating (SIGTERM) 10:23:14.114871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7752): Terminating (SIGTERM) 10:23:14.156598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7755): Terminating (SIGTERM) 10:23:14.198761 --- ParallelTerminationStrategy: PID 7749 died... 10:23:14.218453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7749): Terminated: ok {rc=0} 10:23:14.264349 --- ParallelTerminationStrategy: PID 7752 died... 10:23:14.283899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7752): Terminated: ok {rc=0} 10:23:14.329753 --- ParallelTerminationStrategy: PID 7755 died... 10:23:14.349181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7755): Terminated: ok {rc=0} 10:23:14.435364 bus /sierra_3: Setting Powered False 10:23:15.533641 bus /sierra_3: Setting Powered False 10:23:16.648088 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:23:17.798621 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:23:17.810360 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:23:17.882064 tst mo_mt_call_osmux.py: using LAC 40270 10:23:17.999760 tst mo_mt_call_osmux.py: using RAC 235 10:23:18.125697 tst mo_mt_call_osmux.py: using CellId 40270 10:23:18.251126 tst mo_mt_call_osmux.py: using BVCI 40271 10:23:18.367170 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:23:18.378936 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:23:18.390369 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:23:18.401852 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:23:18.413448 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:23:18.424809 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:23:18.542477 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:23:18.664436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:19.153699 run create_hlr_db(pid=7758): Launched 10:23:19.282621 bus /sierra_2: Setting Powered False 10:23:20.345345 run create_hlr_db(pid=7758): Terminated: ok {rc=0} 10:23:20.786490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7760): Launched 10:23:21.102497 run osmo-hlr_10.42.42.2(pid=7761): Launched 10:23:21.222603 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:21.768624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7763): Launched 10:23:22.084187 run osmo-stp_10.42.42.5(pid=7764): Launched 10:23:22.204219 run osmo-msc_10.42.42.6: Starting osmo-msc 10:23:22.775217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7766): Launched 10:23:23.090983 run osmo-msc_10.42.42.6(pid=7767): Launched 10:23:23.267091 run osmo-stp_10.42.42.5(pid=7764): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7764)] 10:23:23.402582 run osmo-stp_10.42.42.5(pid=7764): stdout: | (launched: 2022-12-14_10:23:22.026560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:23.538311 run osmo-stp_10.42.42.5(pid=7764): stderr: | 20221214102322214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102322214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102322214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102322215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102322215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102322215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102322215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:23.669872 run osmo-stp_10.42.42.5(pid=7764): stdout: | (launched: 2022-12-14_10:23:22.026560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:23.795015 run osmo-stp_10.42.42.5(pid=7764): stderr: | 20221214102322214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102322214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102322214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102322215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102322215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102322215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102322215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:23.944861 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7764): Process ended prematurely: osmo-stp_10.42.42.5(pid=7764) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7764)] [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:23:23.954823 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:23:23.982665 run osmo-hlr_10.42.42.2(pid=7761): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7761)] 10:23:24.032580 run osmo-hlr_10.42.42.2(pid=7761): stdout: | (launched: 2022-12-14_10:23:21.044820) 10:23:24.084102 run osmo-hlr_10.42.42.2(pid=7761): stderr: | 20221214102321237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102321237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102321237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102321238 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102321238 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102321238 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102321250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102321258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102321258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102321258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:24.156011 run osmo-msc_10.42.42.6(pid=7767): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7767)] 10:23:24.205968 run osmo-msc_10.42.42.6(pid=7767): stdout: | (launched: 2022-12-14_10:23:23.033459) 10:23:24.257451 run osmo-msc_10.42.42.6(pid=7767): stderr: | 20221214102323350 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102323351 DLGLOBAL DEBUG validating counter group 0x7f7594a05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102323351 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102323351 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102323351 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102323351 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102323353 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102323353 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102323353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102323353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:23:24.309387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7760): Terminating (SIGTERM) 10:23:24.351019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7763): Terminating (SIGTERM) 10:23:24.392555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7766): Terminating (SIGTERM) 10:23:24.434906 --- ParallelTerminationStrategy: PID 7760 died... 10:23:24.454883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7760): Terminated: ok {rc=0} 10:23:24.500890 --- ParallelTerminationStrategy: PID 7763 died... 10:23:24.520603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7763): Terminated: ok {rc=0} 10:23:24.566974 --- ParallelTerminationStrategy: PID 7766 died... 10:23:24.586377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7766): Terminated: ok {rc=0} 10:23:24.673732 bus /sierra_3: Setting Powered False 10:23:25.770786 bus /sierra_3: Setting Powered False 10:23:26.884392 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 10:23:28.136116 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:28.140901 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:23:28.175139 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 10:23:28.202530 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 10:23:28.290822 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:23:28.325236 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 10:23:28.351702 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 10:23:28.936463 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2403 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 10:23:28.942479 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:23:28.953248 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:23:29.002247 tst emergency_mo_mt_call.py: using LAC 40271 10:23:29.115549 tst emergency_mo_mt_call.py: using RAC 236 10:23:29.230201 tst emergency_mo_mt_call.py: using CellId 40271 10:23:29.342868 tst emergency_mo_mt_call.py: using BVCI 40272 10:23:29.446871 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:23:29.457613 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:23:29.468073 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:23:29.478581 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:23:29.489379 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:23:29.500383 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:23:29.615607 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:23:29.732536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:30.211563 run create_hlr_db(pid=7772): Launched 10:23:30.337473 bus /sierra_2: Setting Powered False 10:23:31.403411 run create_hlr_db(pid=7772): Terminated: ok {rc=0} 10:23:31.854839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7774): Launched 10:23:32.168071 run osmo-hlr_10.42.42.2(pid=7775): Launched 10:23:32.311779 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:32.843908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7777): Launched 10:23:33.152867 run osmo-stp_10.42.42.5(pid=7778): Launched 10:23:33.280799 tst emergency_mo_mt_call.py: using MSISDN 8636 10:23:33.439089 run osmo-msc_10.42.42.6: Starting osmo-msc 10:23:33.994506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7780): Launched 10:23:34.303290 run osmo-msc_10.42.42.6(pid=7781): Launched 10:23:34.474847 run osmo-stp_10.42.42.5(pid=7778): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7778)] 10:23:34.606694 run osmo-stp_10.42.42.5(pid=7778): stdout: | (launched: 2022-12-14_10:23:33.096193) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:34.737751 run osmo-stp_10.42.42.5(pid=7778): stderr: | 20221214102333282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102333282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102333282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102333283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102333283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102333284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102333284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:34.867701 run osmo-stp_10.42.42.5(pid=7778): stdout: | (launched: 2022-12-14_10:23:33.096193) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:34.990254 run osmo-stp_10.42.42.5(pid=7778): stderr: | 20221214102333282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102333282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102333282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102333283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102333283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102333284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102333284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:35.137011 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7778): Process ended prematurely: osmo-stp_10.42.42.5(pid=7778) [trial-2403↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7778)] [trial-2403↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 10:23:35.145973 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 10:23:35.173287 run osmo-hlr_10.42.42.2(pid=7775): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7775)] 10:23:35.223491 run osmo-hlr_10.42.42.2(pid=7775): stdout: | (launched: 2022-12-14_10:23:32.109721) 10:23:35.275397 run osmo-hlr_10.42.42.2(pid=7775): stderr: | 20221214102332328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102332328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102332328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102332328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102332328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102332329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102332341 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102332350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102332350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102332350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:35.347367 run osmo-msc_10.42.42.6(pid=7781): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7781)] 10:23:35.397401 run osmo-msc_10.42.42.6(pid=7781): stdout: | (launched: 2022-12-14_10:23:34.246562) 10:23:35.449158 run osmo-msc_10.42.42.6(pid=7781): stderr: | 20221214102334563 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102334563 DLGLOBAL DEBUG validating counter group 0x7f0031a3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102334563 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102334563 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102334563 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102334564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102334565 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102334566 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102334566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102334566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:23:35.501049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7774): Terminating (SIGTERM) 10:23:35.543188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7777): Terminating (SIGTERM) 10:23:35.585645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7780): Terminating (SIGTERM) 10:23:35.627652 --- ParallelTerminationStrategy: PID 7774 died... 10:23:35.647930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7774): Terminated: ok {rc=0} 10:23:35.694445 --- ParallelTerminationStrategy: PID 7777 died... 10:23:35.714042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7777): Terminated: ok {rc=0} 10:23:35.759681 --- ParallelTerminationStrategy: PID 7780 died... 10:23:35.779252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7780): Terminated: ok {rc=0} 10:23:35.866553 bus /sierra_3: Setting Powered False 10:23:36.965524 bus /sierra_3: Setting Powered False 10:23:38.081766 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 10:23:39.169483 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:23:39.181263 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:23:39.237248 tst emergency_preemptive_call.py: using LAC 40272 10:23:39.357059 tst emergency_preemptive_call.py: using RAC 237 10:23:39.475741 tst emergency_preemptive_call.py: using CellId 40272 10:23:39.595488 tst emergency_preemptive_call.py: using BVCI 40273 10:23:39.706722 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:23:39.717957 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:23:39.728913 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:23:39.739911 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:23:39.750962 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:23:39.762041 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:23:39.878572 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:23:39.992109 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:23:40.109384 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:23:40.226543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:40.708061 run create_hlr_db(pid=7783): Launched 10:23:40.834831 bus /sierra_2: Setting Powered False 10:23:41.897287 run create_hlr_db(pid=7783): Terminated: ok {rc=0} 10:23:42.314762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7785): Launched 10:23:42.606300 run osmo-hlr_10.42.42.2(pid=7786): Launched 10:23:42.717514 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:43.220123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7788): Launched 10:23:43.510718 run osmo-stp_10.42.42.5(pid=7789): Launched 10:23:43.630682 tst emergency_preemptive_call.py: using MSISDN 8637 10:23:43.780229 run osmo-msc_10.42.42.6: Starting osmo-msc 10:23:44.300231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7791): Launched 10:23:44.590282 run osmo-msc_10.42.42.6(pid=7792): Launched 10:23:44.751536 run osmo-stp_10.42.42.5(pid=7789): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7789)] 10:23:44.874923 run osmo-stp_10.42.42.5(pid=7789): stdout: | (launched: 2022-12-14_10:23:43.457043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:44.998247 run osmo-stp_10.42.42.5(pid=7789): stderr: | 20221214102343624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102343624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102343624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102343625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102343625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102343625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102343625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:45.119076 run osmo-stp_10.42.42.5(pid=7789): stdout: | (launched: 2022-12-14_10:23:43.457043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:45.234109 run osmo-stp_10.42.42.5(pid=7789): stderr: | 20221214102343624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102343624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102343624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102343625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102343625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102343625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102343625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:45.372419 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7789): Process ended prematurely: osmo-stp_10.42.42.5(pid=7789) [trial-2403↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7789)] [trial-2403↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 10:23:45.380705 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 10:23:45.406580 run osmo-hlr_10.42.42.2(pid=7786): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7786)] 10:23:45.454716 run osmo-hlr_10.42.42.2(pid=7786): stdout: | (launched: 2022-12-14_10:23:42.552321) 10:23:45.504043 run osmo-hlr_10.42.42.2(pid=7786): stderr: | 20221214102342720 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102342720 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102342720 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102342720 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102342720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102342720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102342733 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102342742 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102342742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102342742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:45.573418 run osmo-msc_10.42.42.6(pid=7792): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7792)] 10:23:45.620731 run osmo-msc_10.42.42.6(pid=7792): stdout: | (launched: 2022-12-14_10:23:44.536363) 10:23:45.670021 run osmo-msc_10.42.42.6(pid=7792): stderr: | 20221214102344804 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102344804 DLGLOBAL DEBUG validating counter group 0x7fe534a2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102344804 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102344804 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102344804 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102344805 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102344806 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102344807 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102344807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102344807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:23:45.719783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7785): Terminating (SIGTERM) 10:23:45.759592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7788): Terminating (SIGTERM) 10:23:45.799152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7791): Terminating (SIGTERM) 10:23:45.839658 --- ParallelTerminationStrategy: PID 7785 died... 10:23:45.859195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7785): Terminated: ok {rc=0} 10:23:45.905160 --- ParallelTerminationStrategy: PID 7788 died... 10:23:45.924206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7788): Terminated: ok {rc=0} 10:23:45.969048 --- ParallelTerminationStrategy: PID 7791 died... 10:23:45.988304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7791): Terminated: ok {rc=0} 10:23:46.073878 bus /sierra_9: Setting Powered False 10:23:47.177836 bus /sierra_9: Setting Powered False 10:23:48.292514 bus /sierra_8: Setting Powered False 10:23:49.390557 bus /sierra_8: Setting Powered False 10:23:50.507956 bus /sierra_3: Setting Powered False 10:23:51.606206 bus /sierra_3: Setting Powered False 10:23:52.719878 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 10:23:54.008216 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:54.012901 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:23:54.047093 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 10:23:54.086522 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 10:23:54.174372 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:23:54.209102 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 10:23:54.248042 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 10:23:54.843596 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 10:23:54.895473 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:23:54.906738 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:23:54.955732 tst cs_paging_gprs_active.py: using LAC 40273 10:23:55.078669 tst cs_paging_gprs_active.py: using RAC 238 10:23:55.202395 tst cs_paging_gprs_active.py: using CellId 40273 10:23:55.326263 tst cs_paging_gprs_active.py: using BVCI 40274 10:23:55.440768 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:23:55.452159 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:23:55.463359 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:23:55.474548 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:23:55.485728 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:23:55.496721 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:23:55.508076 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:23:55.519458 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:23:55.530842 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:23:55.647988 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:23:55.767970 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:23:55.969022 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:23:56.270344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7798): Launched 10:23:56.530709 run iperf3-srv_10.42.42.10(pid=7799): Launched 10:23:56.642651 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:23:56.841626 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:23:57.140317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7800): Launched 10:23:57.398936 run iperf3-srv_10.42.42.10(pid=7801): Launched 10:23:57.511002 tst cs_paging_gprs_active.py:38: start network... 10:23:57.709260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:58.170694 run create_hlr_db(pid=7802): Launched 10:23:58.286506 bus /sierra_2: Setting Powered False 10:23:59.345927 run create_hlr_db(pid=7802): Terminated: ok {rc=0} 10:23:59.761268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7804): Launched 10:24:00.060086 run osmo-hlr_10.42.42.2(pid=7805): Launched 10:24:00.174174 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:00.697816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7807): Launched 10:24:01.023503 run osmo-stp_10.42.42.5(pid=7808): Launched 10:24:01.253462 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:24:01.959215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7842): Launched 10:24:02.087037 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:24:02.353747 run patchelf(pid=7847): Launched 10:24:02.574886 run osmo-stp_10.42.42.5(pid=7808): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7808)] 10:24:02.712209 run osmo-stp_10.42.42.5(pid=7808): stdout: | (launched: 2022-12-14_10:24:00.964512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:02.861592 run osmo-stp_10.42.42.5(pid=7808): stderr: | 20221214102401293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102401293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102401293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102401293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102401294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102401294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102401294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:03.007299 run osmo-stp_10.42.42.5(pid=7808): stdout: | (launched: 2022-12-14_10:24:00.964512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:03.162163 run osmo-stp_10.42.42.5(pid=7808): stderr: | 20221214102401293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102401293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102401293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102401293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102401294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102401294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102401294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:03.349817 run patchelf(pid=7847): Terminating (SIGINT) 10:24:03.562593 run patchelf(pid=7847): Terminated: ok {rc=0} 10:24:03.714576 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7808): Process ended prematurely: osmo-stp_10.42.42.5(pid=7808) [trial-2403↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7808)] [trial-2403↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 10:24:03.725580 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 10:24:03.760704 run osmo-hlr_10.42.42.2(pid=7805): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7805)] 10:24:03.825216 run osmo-hlr_10.42.42.2(pid=7805): stdout: | (launched: 2022-12-14_10:24:00.004488) 10:24:03.884728 run osmo-hlr_10.42.42.2(pid=7805): stderr: | 20221214102400174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102400174 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102400174 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102400174 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102400174 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102400174 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102400186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102400195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102400195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102400195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:03.948064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7798): Terminating (SIGTERM) 10:24:03.998506 run iperf3-srv_10.42.42.10(pid=7799): Terminating (SIGTERM) 10:24:04.056025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7800): Terminating (SIGTERM) 10:24:04.109355 run iperf3-srv_10.42.42.10(pid=7801): Terminating (SIGTERM) 10:24:04.158638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7804): Terminating (SIGTERM) 10:24:04.210995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7807): Terminating (SIGTERM) 10:24:04.260241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7842): Terminating (SIGTERM) 10:24:04.312879 --- ParallelTerminationStrategy: PID 7798 died... 10:24:04.334068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7798): Terminated: ok {rc=0} 10:24:04.392643 --- ParallelTerminationStrategy: PID 7799 died... 10:24:04.416044 run iperf3-srv_10.42.42.10(pid=7799): Terminated {rc=256} 10:24:04.468562 --- ParallelTerminationStrategy: PID 7800 died... 10:24:04.494095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7800): Terminated: ok {rc=0} 10:24:04.552128 --- ParallelTerminationStrategy: PID 7801 died... 10:24:04.579322 run iperf3-srv_10.42.42.10(pid=7801): Terminated {rc=256} 10:24:04.640359 --- ParallelTerminationStrategy: PID 7804 died... 10:24:04.668908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7804): Terminated: ok {rc=0} 10:24:04.717287 --- ParallelTerminationStrategy: PID 7807 died... 10:24:04.738013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7807): Terminated: ok {rc=0} 10:24:04.784321 --- ParallelTerminationStrategy: PID 7842 died... 10:24:04.805130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7842): Terminated: ok {rc=0} 10:24:04.904796 bus /gobi_0: Setting Powered False 10:24:06.007038 bus /gobi_0: Setting Powered False 10:24:07.123865 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 10:24:08.274750 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:08.286966 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:24:08.341146 tst iperf3.py: using LAC 40274 10:24:08.464031 tst iperf3.py: using RAC 239 10:24:08.584806 tst iperf3.py: using CellId 40274 10:24:08.707584 tst iperf3.py: using BVCI 40275 10:24:08.822685 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:08.834348 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:08.845886 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:08.857319 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:08.869888 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:08.882908 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:08.895885 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:08.908336 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:08.921434 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:24:09.046164 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:24:09.254721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:09.575205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8084): Launched 10:24:09.861395 run iperf3-srv_10.42.42.10(pid=8085): Launched 10:24:09.993165 tst iperf3.py:8: start network... 10:24:10.204194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:10.692859 run create_hlr_db(pid=8086): Launched 10:24:10.854994 bus /gobi_6: Setting Powered False 10:24:11.916313 run create_hlr_db(pid=8086): Terminated: ok {rc=0} 10:24:12.353789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8088): Launched 10:24:12.690190 run osmo-hlr_10.42.42.2(pid=8089): Launched 10:24:12.935409 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:13.635506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8091): Launched 10:24:13.963979 run osmo-stp_10.42.42.5(pid=8092): Launched 10:24:14.207814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:24:14.889535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8094): Launched 10:24:15.023464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:24:15.292113 run patchelf(pid=8095): Launched 10:24:15.483732 run osmo-stp_10.42.42.5(pid=8092): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8092)] 10:24:15.620301 run osmo-stp_10.42.42.5(pid=8092): stdout: | (launched: 2022-12-14_10:24:13.903050) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:15.756587 run osmo-stp_10.42.42.5(pid=8092): stderr: | 20221214102414232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102414232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102414232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102414232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102414233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102414233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102414233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:15.897308 run osmo-stp_10.42.42.5(pid=8092): stdout: | (launched: 2022-12-14_10:24:13.903050) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:16.033381 run osmo-stp_10.42.42.5(pid=8092): stderr: | 20221214102414232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102414232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102414232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102414232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102414233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102414233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102414233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:16.203406 run patchelf(pid=8095): Terminating (SIGINT) 10:24:16.382108 run patchelf(pid=8095): Terminated: ok {rc=0} 10:24:16.513421 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8092): Process ended prematurely: osmo-stp_10.42.42.5(pid=8092) [trial-2403↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8092)] [trial-2403↪gprs:trx-sysmocell5000↪iperf3.py:8] 10:24:16.524758 tst iperf3.py:8: Test FAILED (8.3 sec) 10:24:16.554195 run osmo-hlr_10.42.42.2(pid=8089): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8089)] 10:24:16.609225 run osmo-hlr_10.42.42.2(pid=8089): stdout: | (launched: 2022-12-14_10:24:12.624633) 10:24:16.661992 run osmo-hlr_10.42.42.2(pid=8089): stderr: | 20221214102412961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102412961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102412961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102412961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102412961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102412962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102412984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102412992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102412992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102412992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:16.715758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8084): Terminating (SIGTERM) 10:24:16.758254 run iperf3-srv_10.42.42.10(pid=8085): Terminating (SIGTERM) 10:24:16.805617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8088): Terminating (SIGTERM) 10:24:16.849493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8091): Terminating (SIGTERM) 10:24:16.894773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8094): Terminating (SIGTERM) 10:24:16.940056 --- ParallelTerminationStrategy: PID 8084 died... 10:24:16.961565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8084): Terminated: ok {rc=0} 10:24:17.011048 --- ParallelTerminationStrategy: PID 8085 died... 10:24:17.031641 run iperf3-srv_10.42.42.10(pid=8085): Terminated {rc=256} 10:24:17.078935 --- ParallelTerminationStrategy: PID 8088 died... 10:24:17.099973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8088): Terminated: ok {rc=0} 10:24:17.146952 --- ParallelTerminationStrategy: PID 8091 died... 10:24:17.167997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8091): Terminated: ok {rc=0} 10:24:17.216573 --- ParallelTerminationStrategy: PID 8094 died... 10:24:17.237751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8094): Terminated: ok {rc=0} 10:24:17.338512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 10:24:18.512559 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:18.525547 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:24:18.577324 tst iperf3m4.py: using LAC 40275 10:24:18.703921 tst iperf3m4.py: using RAC 240 10:24:18.827614 tst iperf3m4.py: using CellId 40275 10:24:18.949889 tst iperf3m4.py: using BVCI 40276 10:24:19.066500 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:19.078397 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:19.090821 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:19.102708 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:19.115737 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:19.128401 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:19.141486 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:19.154304 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:19.167216 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:24:19.292404 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:24:19.417659 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:24:19.544354 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:24:19.667599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:24:19.880601 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:20.199788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8096): Launched 10:24:20.490585 run iperf3-srv_10.42.42.10(pid=8097): Launched 10:24:20.626927 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:24:20.839661 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:21.160350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8098): Launched 10:24:21.452203 run iperf3-srv_10.42.42.10(pid=8099): Launched 10:24:21.587294 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:24:21.801813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:22.121852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8100): Launched 10:24:22.413115 run iperf3-srv_10.42.42.10(pid=8101): Launched 10:24:22.548621 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:24:22.763245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:23.085714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8102): Launched 10:24:23.375523 run iperf3-srv_10.42.42.10(pid=8103): Launched 10:24:23.512842 tst iperf3m4.py:8: start network... 10:24:23.726806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:24.223872 run create_hlr_db(pid=8104): Launched 10:24:24.387297 bus /gobi_6: Setting Powered False 10:24:25.448064 run create_hlr_db(pid=8104): Terminated: ok {rc=0} 10:24:25.877366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8106): Launched 10:24:26.184548 run osmo-hlr_10.42.42.2(pid=8107): Launched 10:24:26.300502 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:26.842082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8109): Launched 10:24:27.149713 run osmo-stp_10.42.42.5(pid=8110): Launched 10:24:27.266204 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:24:27.793950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8112): Launched 10:24:27.911915 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:24:28.171016 run patchelf(pid=8113): Launched 10:24:28.342367 run osmo-stp_10.42.42.5(pid=8110): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8110)] 10:24:28.472758 run osmo-stp_10.42.42.5(pid=8110): stdout: | (launched: 2022-12-14_10:24:27.093144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:28.604767 run osmo-stp_10.42.42.5(pid=8110): stderr: | 20221214102427263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102427263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102427263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102427263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102427264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102427264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102427264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:28.736903 run osmo-stp_10.42.42.5(pid=8110): stdout: | (launched: 2022-12-14_10:24:27.093144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:28.862635 run osmo-stp_10.42.42.5(pid=8110): stderr: | 20221214102427263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102427263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102427263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102427263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102427264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102427264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102427264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:29.011843 run patchelf(pid=8113): Terminating (SIGINT) 10:24:29.184576 run patchelf(pid=8113): Terminated: ok {rc=0} 10:24:29.309438 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8110): Process ended prematurely: osmo-stp_10.42.42.5(pid=8110) [trial-2403↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8110)] [trial-2403↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 10:24:29.319069 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:24:29.346748 run osmo-hlr_10.42.42.2(pid=8107): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8107)] 10:24:29.395284 run osmo-hlr_10.42.42.2(pid=8107): stdout: | (launched: 2022-12-14_10:24:26.127459) 10:24:29.445538 run osmo-hlr_10.42.42.2(pid=8107): stderr: | 20221214102426300 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102426300 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102426300 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102426300 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102426300 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102426300 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102426312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102426320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102426320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102426320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:29.496206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8096): Terminating (SIGTERM) 10:24:29.536926 run iperf3-srv_10.42.42.10(pid=8097): Terminating (SIGTERM) 10:24:29.577536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8098): Terminating (SIGTERM) 10:24:29.618234 run iperf3-srv_10.42.42.10(pid=8099): Terminating (SIGTERM) 10:24:29.658618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8100): Terminating (SIGTERM) 10:24:29.699045 run iperf3-srv_10.42.42.10(pid=8101): Terminating (SIGTERM) 10:24:29.739332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8102): Terminating (SIGTERM) 10:24:29.779728 run iperf3-srv_10.42.42.10(pid=8103): Terminating (SIGTERM) 10:24:29.820062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8106): Terminating (SIGTERM) 10:24:29.860535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8109): Terminating (SIGTERM) 10:24:29.900769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8112): Terminating (SIGTERM) 10:24:29.941574 --- ParallelTerminationStrategy: PID 8096 died... 10:24:29.961554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8096): Terminated: ok {rc=0} 10:24:30.006138 --- ParallelTerminationStrategy: PID 8097 died... 10:24:30.025336 run iperf3-srv_10.42.42.10(pid=8097): Terminated {rc=256} 10:24:30.069540 --- ParallelTerminationStrategy: PID 8098 died... 10:24:30.088706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8098): Terminated: ok {rc=0} 10:24:30.133220 --- ParallelTerminationStrategy: PID 8099 died... 10:24:30.152060 run iperf3-srv_10.42.42.10(pid=8099): Terminated {rc=256} 10:24:30.196371 --- ParallelTerminationStrategy: PID 8100 died... 10:24:30.215648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8100): Terminated: ok {rc=0} 10:24:30.260091 --- ParallelTerminationStrategy: PID 8101 died... 10:24:30.279136 run iperf3-srv_10.42.42.10(pid=8101): Terminated {rc=256} 10:24:30.323391 --- ParallelTerminationStrategy: PID 8102 died... 10:24:30.342527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8102): Terminated: ok {rc=0} 10:24:30.386963 --- ParallelTerminationStrategy: PID 8103 died... 10:24:30.406113 run iperf3-srv_10.42.42.10(pid=8103): Terminated {rc=256} 10:24:30.450503 --- ParallelTerminationStrategy: PID 8106 died... 10:24:30.469864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8106): Terminated: ok {rc=0} 10:24:30.514611 --- ParallelTerminationStrategy: PID 8109 died... 10:24:30.533798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8109): Terminated: ok {rc=0} 10:24:30.578207 --- ParallelTerminationStrategy: PID 8112 died... 10:24:30.597397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8112): Terminated: ok {rc=0} 10:24:30.684437 bus /gobi_4: Setting Powered False 10:24:31.793650 bus /gobi_4: Setting Powered False 10:24:32.925201 bus /gobi_1: Setting Powered False 10:24:34.024707 bus /gobi_1: Setting Powered False 10:24:35.142432 bus /gobi_0: Setting Powered False 10:24:36.243255 bus /gobi_0: Setting Powered False 10:24:37.361011 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 10:24:38.468195 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:38.480202 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:24:38.534776 tst ping.py: using LAC 40276 10:24:38.652182 tst ping.py: using RAC 241 10:24:38.771828 tst ping.py: using CellId 40276 10:24:38.888514 tst ping.py: using BVCI 40277 10:24:38.996728 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:39.007596 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:39.018370 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:39.028726 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:39.039543 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:39.050379 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:39.061492 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:39.072223 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:24:39.187812 tst ping.py:19: start network... 10:24:39.388229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:39.849646 run create_hlr_db(pid=8114): Launched 10:24:39.962865 bus /gobi_6: Setting Powered False 10:24:41.022384 run create_hlr_db(pid=8114): Terminated: ok {rc=0} 10:24:41.439775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8116): Launched 10:24:41.739262 run osmo-hlr_10.42.42.2(pid=8117): Launched 10:24:41.854326 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:42.370007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8119): Launched 10:24:42.669965 run osmo-stp_10.42.42.5(pid=8120): Launched 10:24:42.784260 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:24:43.299041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8122): Launched 10:24:43.413962 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:24:43.666365 run patchelf(pid=8123): Launched 10:24:43.834895 run osmo-stp_10.42.42.5(pid=8120): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8120)] 10:24:43.961630 run osmo-stp_10.42.42.5(pid=8120): stdout: | (launched: 2022-12-14_10:24:42.614729) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:44.090433 run osmo-stp_10.42.42.5(pid=8120): stderr: | 20221214102442781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102442781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102442782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102442782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102442782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102442783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102442783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:44.219407 run osmo-stp_10.42.42.5(pid=8120): stdout: | (launched: 2022-12-14_10:24:42.614729) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:44.341712 run osmo-stp_10.42.42.5(pid=8120): stderr: | 20221214102442781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102442781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102442782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102442782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102442782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102442783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102442783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:44.486990 run patchelf(pid=8123): Terminating (SIGINT) 10:24:44.655363 run patchelf(pid=8123): Terminated: ok {rc=0} 10:24:44.777296 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8120): Process ended prematurely: osmo-stp_10.42.42.5(pid=8120) [trial-2403↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8120)] [trial-2403↪gprs:trx-sysmocell5000↪ping.py:22] 10:24:44.786248 tst ping.py:22: Test FAILED (6.3 sec) 10:24:44.813431 run osmo-hlr_10.42.42.2(pid=8117): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8117)] 10:24:44.862237 run osmo-hlr_10.42.42.2(pid=8117): stdout: | (launched: 2022-12-14_10:24:41.684052) 10:24:44.912420 run osmo-hlr_10.42.42.2(pid=8117): stderr: | 20221214102441859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102441859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102441859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102441859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102441859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102441859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102441895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102441905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102441905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102441905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:44.963107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8116): Terminating (SIGTERM) 10:24:45.003713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8119): Terminating (SIGTERM) 10:24:45.044069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8122): Terminating (SIGTERM) 10:24:45.084622 --- ParallelTerminationStrategy: PID 8116 died... 10:24:45.104395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8116): Terminated: ok {rc=0} 10:24:45.149066 --- ParallelTerminationStrategy: PID 8119 died... 10:24:45.168425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8119): Terminated: ok {rc=0} 10:24:45.213101 --- ParallelTerminationStrategy: PID 8122 died... 10:24:45.232127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8122): Terminated: ok {rc=0} 10:24:45.318669 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 10:24:46.418559 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:46.439177 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:24:46.492670 tst ping_idle_ping.py: using LAC 40277 10:24:46.612313 tst ping_idle_ping.py: using RAC 242 10:24:46.771863 tst ping_idle_ping.py: using CellId 40277 10:24:46.916336 tst ping_idle_ping.py: using BVCI 40278 10:24:47.029294 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:47.041277 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:47.052672 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:47.064283 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:47.076942 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:47.089802 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:47.102734 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:24:47.115170 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:24:47.243155 tst ping_idle_ping.py:24: start network... 10:24:47.449816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:47.915403 run create_hlr_db(pid=8124): Launched 10:24:48.030583 bus /gobi_6: Setting Powered False 10:24:49.091646 run create_hlr_db(pid=8124): Terminated: ok {rc=0} 10:24:49.532043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8127): Launched 10:24:49.852043 run osmo-hlr_10.42.42.2(pid=8128): Launched 10:24:49.974357 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:50.528075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8130): Launched 10:24:50.846662 run osmo-stp_10.42.42.5(pid=8131): Launched 10:24:50.969514 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:24:51.518297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8133): Launched 10:24:51.642226 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:24:51.910534 run patchelf(pid=8134): Launched 10:24:52.090004 run osmo-stp_10.42.42.5(pid=8131): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8131)] 10:24:52.225618 run osmo-stp_10.42.42.5(pid=8131): stdout: | (launched: 2022-12-14_10:24:50.788325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:52.363133 run osmo-stp_10.42.42.5(pid=8131): stderr: | 20221214102450976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102450977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102450977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102450977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102450978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102450978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102450978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:52.501104 run osmo-stp_10.42.42.5(pid=8131): stdout: | (launched: 2022-12-14_10:24:50.788325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:52.632445 run osmo-stp_10.42.42.5(pid=8131): stderr: | 20221214102450976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102450977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102450977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102450977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102450978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102450978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102450978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:52.787294 run patchelf(pid=8134): Terminating (SIGINT) 10:24:52.967136 run patchelf(pid=8134): Terminated: ok {rc=0} 10:24:53.097255 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8131): Process ended prematurely: osmo-stp_10.42.42.5(pid=8131) [trial-2403↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8131)] [trial-2403↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 10:24:53.107170 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:24:53.135676 run osmo-hlr_10.42.42.2(pid=8128): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8128)] 10:24:53.186477 run osmo-hlr_10.42.42.2(pid=8128): stdout: | (launched: 2022-12-14_10:24:49.793502) 10:24:53.238574 run osmo-hlr_10.42.42.2(pid=8128): stderr: | 20221214102449987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102449987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102449987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102449987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102449987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102449987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102450000 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102450010 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102450010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102450010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:53.291671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8127): Terminating (SIGTERM) 10:24:53.333841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8130): Terminating (SIGTERM) 10:24:53.375825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8133): Terminating (SIGTERM) 10:24:53.418896 --- ParallelTerminationStrategy: PID 8127 died... 10:24:53.438939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8127): Terminated: ok {rc=0} 10:24:53.485280 --- ParallelTerminationStrategy: PID 8130 died... 10:24:53.504619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8130): Terminated: ok {rc=0} 10:24:53.551147 --- ParallelTerminationStrategy: PID 8133 died... 10:24:53.570828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8133): Terminated: ok {rc=0} 10:24:53.659062 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 10:24:54.972882 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:24:54.978745 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:24:55.012885 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:24:55.052052 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:24:55.142277 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:24:55.176601 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:24:55.215825 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:24:55.809931 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:24:55.862297 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:24:55.873797 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:24:55.932564 tst cs_paging_gprs_active.py: using LAC 40278 10:24:56.072240 tst cs_paging_gprs_active.py: using RAC 243 10:24:56.201523 tst cs_paging_gprs_active.py: using CellId 40278 10:24:56.329201 tst cs_paging_gprs_active.py: using BVCI 40279 10:24:56.442360 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:24:56.453722 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:24:56.464545 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:24:56.475358 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:24:56.486594 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:24:56.497883 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:24:56.508905 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:24:56.519889 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:24:56.531075 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:24:56.651961 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:24:56.771356 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:24:56.977775 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:57.286395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8138): Launched 10:24:57.556543 run iperf3-srv_10.42.42.10(pid=8139): Launched 10:24:57.675077 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:24:57.880352 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:24:58.188492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8140): Launched 10:24:58.456635 run iperf3-srv_10.42.42.10(pid=8141): Launched 10:24:58.572429 tst cs_paging_gprs_active.py:38: start network... 10:24:58.776704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:59.250808 run create_hlr_db(pid=8142): Launched 10:24:59.370381 bus /gobi_6: Setting Powered False 10:25:00.431045 run create_hlr_db(pid=8142): Terminated: ok {rc=0} 10:25:00.889780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8144): Launched 10:25:01.289463 run osmo-hlr_10.42.42.2(pid=8147): Launched 10:25:01.528359 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:02.218218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8150): Launched 10:25:02.559674 run osmo-stp_10.42.42.5(pid=8151): Launched 10:25:02.684921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:25:03.259202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8153): Launched 10:25:03.386255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:25:03.658034 run patchelf(pid=8154): Launched 10:25:03.832167 run osmo-stp_10.42.42.5(pid=8151): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8151)] 10:25:03.963237 run osmo-stp_10.42.42.5(pid=8151): stdout: | (launched: 2022-12-14_10:25:02.499422) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:04.095341 run osmo-stp_10.42.42.5(pid=8151): stderr: | 20221214102502692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102502692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102502693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102502693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102502694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102502694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102502694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:04.227607 run osmo-stp_10.42.42.5(pid=8151): stdout: | (launched: 2022-12-14_10:25:02.499422) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:04.353979 run osmo-stp_10.42.42.5(pid=8151): stderr: | 20221214102502692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102502692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102502693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102502693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102502694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102502694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102502694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:04.503100 run patchelf(pid=8154): Terminating (SIGINT) 10:25:04.676678 run patchelf(pid=8154): Terminated: ok {rc=0} 10:25:04.801954 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8151): Process ended prematurely: osmo-stp_10.42.42.5(pid=8151) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8151)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:25:04.811737 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 10:25:04.839020 run osmo-hlr_10.42.42.2(pid=8147): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8147)] 10:25:04.887623 run osmo-hlr_10.42.42.2(pid=8147): stdout: | (launched: 2022-12-14_10:25:01.227953) 10:25:04.937724 run osmo-hlr_10.42.42.2(pid=8147): stderr: | 20221214102501470 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102501470 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102501470 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102501470 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102501470 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102501470 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102501487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102501502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102501502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102501502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:04.988435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8138): Terminating (SIGTERM) 10:25:05.029193 run iperf3-srv_10.42.42.10(pid=8139): Terminating (SIGTERM) 10:25:05.069619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8140): Terminating (SIGTERM) 10:25:05.110243 run iperf3-srv_10.42.42.10(pid=8141): Terminating (SIGTERM) 10:25:05.150675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8144): Terminating (SIGTERM) 10:25:05.191237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8150): Terminating (SIGTERM) 10:25:05.231641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8153): Terminating (SIGTERM) 10:25:05.272385 --- ParallelTerminationStrategy: PID 8138 died... 10:25:05.292272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8138): Terminated: ok {rc=0} 10:25:05.337397 --- ParallelTerminationStrategy: PID 8139 died... 10:25:05.356480 run iperf3-srv_10.42.42.10(pid=8139): Terminated {rc=256} 10:25:05.400918 --- ParallelTerminationStrategy: PID 8140 died... 10:25:05.420418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8140): Terminated: ok {rc=0} 10:25:05.464813 --- ParallelTerminationStrategy: PID 8141 died... 10:25:05.484426 run iperf3-srv_10.42.42.10(pid=8141): Terminated {rc=256} 10:25:05.528873 --- ParallelTerminationStrategy: PID 8144 died... 10:25:05.548588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8144): Terminated: ok {rc=0} 10:25:05.593050 --- ParallelTerminationStrategy: PID 8150 died... 10:25:05.612210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8150): Terminated: ok {rc=0} 10:25:05.656390 --- ParallelTerminationStrategy: PID 8153 died... 10:25:05.675615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8153): Terminated: ok {rc=0} 10:25:05.762912 bus /gobi_0: Setting Powered False 10:25:06.863603 bus /gobi_0: Setting Powered False 10:25:07.978977 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:25:09.126428 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:09.138230 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:25:09.193142 tst iperf3.py: using LAC 40279 10:25:09.314419 tst iperf3.py: using RAC 244 10:25:09.434430 tst iperf3.py: using CellId 40279 10:25:09.555806 tst iperf3.py: using BVCI 40280 10:25:09.666663 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:09.678162 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:09.688923 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:09.699838 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:09.710918 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:09.722106 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:09.733422 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:09.744330 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:09.755631 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:25:09.874883 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:25:10.094030 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:25:10.420823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8155): Launched 10:25:10.706536 run iperf3-srv_10.42.42.10(pid=8156): Launched 10:25:10.830378 tst iperf3.py:8: start network... 10:25:11.049398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:11.553208 run create_hlr_db(pid=8157): Launched 10:25:11.687884 bus /gobi_6: Setting Powered False 10:25:12.751768 run create_hlr_db(pid=8157): Terminated: ok {rc=0} 10:25:13.187740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8159): Launched 10:25:13.515648 run osmo-hlr_10.42.42.2(pid=8160): Launched 10:25:13.639086 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:14.201158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8162): Launched 10:25:14.526212 run osmo-stp_10.42.42.5(pid=8163): Launched 10:25:14.651770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:25:15.210709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8165): Launched 10:25:15.336251 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:25:15.610917 run patchelf(pid=8166): Launched 10:25:15.793309 run osmo-stp_10.42.42.5(pid=8163): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8163)] 10:25:15.932674 run osmo-stp_10.42.42.5(pid=8163): stdout: | (launched: 2022-12-14_10:25:14.466689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:16.074517 run osmo-stp_10.42.42.5(pid=8163): stderr: | 20221214102514659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102514659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102514660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102514660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102514660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102514660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102514661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:16.216437 run osmo-stp_10.42.42.5(pid=8163): stdout: | (launched: 2022-12-14_10:25:14.466689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:16.351773 run osmo-stp_10.42.42.5(pid=8163): stderr: | 20221214102514659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102514659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102514660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102514660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102514660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102514660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102514661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:16.512238 run patchelf(pid=8166): Terminating (SIGINT) 10:25:16.698398 run patchelf(pid=8166): Terminated: ok {rc=0} 10:25:16.832501 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8163): Process ended prematurely: osmo-stp_10.42.42.5(pid=8163) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8163)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 10:25:16.843565 tst iperf3.py:8: Test FAILED (7.8 sec) 10:25:16.873145 run osmo-hlr_10.42.42.2(pid=8160): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8160)] 10:25:16.924558 run osmo-hlr_10.42.42.2(pid=8160): stdout: | (launched: 2022-12-14_10:25:13.456252) 10:25:16.977641 run osmo-hlr_10.42.42.2(pid=8160): stderr: | 20221214102513654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102513654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102513654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102513655 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102513655 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102513655 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102513667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102513675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102513675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102513676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:17.030977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8155): Terminating (SIGTERM) 10:25:17.074456 run iperf3-srv_10.42.42.10(pid=8156): Terminating (SIGTERM) 10:25:17.118478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8159): Terminating (SIGTERM) 10:25:17.161767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8162): Terminating (SIGTERM) 10:25:17.205777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8165): Terminating (SIGTERM) 10:25:17.248649 --- ParallelTerminationStrategy: PID 8155 died... 10:25:17.268777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8155): Terminated: ok {rc=0} 10:25:17.315028 --- ParallelTerminationStrategy: PID 8156 died... 10:25:17.334473 run iperf3-srv_10.42.42.10(pid=8156): Terminated {rc=256} 10:25:17.380649 --- ParallelTerminationStrategy: PID 8159 died... 10:25:17.400301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8159): Terminated: ok {rc=0} 10:25:17.446444 --- ParallelTerminationStrategy: PID 8162 died... 10:25:17.465993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8162): Terminated: ok {rc=0} 10:25:17.512000 --- ParallelTerminationStrategy: PID 8165 died... 10:25:17.531571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8165): Terminated: ok {rc=0} 10:25:17.619894 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:25:18.770896 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:18.782990 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:25:18.837803 tst iperf3m4.py: using LAC 40280 10:25:18.966270 tst iperf3m4.py: using RAC 245 10:25:19.093649 tst iperf3m4.py: using CellId 40280 10:25:19.213918 tst iperf3m4.py: using BVCI 40281 10:25:19.324733 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:19.335830 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:19.346816 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:19.357629 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:19.368743 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:19.379826 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:19.391035 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:19.402047 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:19.413203 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:25:19.535344 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:25:19.658703 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:25:19.776242 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:25:19.894197 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:25:20.100505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:25:20.409108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8167): Launched 10:25:20.677473 run iperf3-srv_10.42.42.10(pid=8168): Launched 10:25:20.793399 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:25:20.998809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:25:21.306636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8169): Launched 10:25:21.576009 run iperf3-srv_10.42.42.10(pid=8170): Launched 10:25:21.691599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:25:21.896469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:25:22.203475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8171): Launched 10:25:22.470979 run iperf3-srv_10.42.42.10(pid=8172): Launched 10:25:22.587311 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:25:22.791444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:25:23.098095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8173): Launched 10:25:23.367266 run iperf3-srv_10.42.42.10(pid=8174): Launched 10:25:23.482660 tst iperf3m4.py:8: start network... 10:25:23.686968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:24.158592 run create_hlr_db(pid=8175): Launched 10:25:24.276226 bus /gobi_6: Setting Powered False 10:25:25.337295 run create_hlr_db(pid=8175): Terminated: ok {rc=0} 10:25:25.784139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8177): Launched 10:25:26.111716 run osmo-hlr_10.42.42.2(pid=8178): Launched 10:25:26.235369 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:26.796397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8180): Launched 10:25:27.122944 run osmo-stp_10.42.42.5(pid=8181): Launched 10:25:27.246566 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:25:27.806907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8183): Launched 10:25:27.933500 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:25:28.208859 run patchelf(pid=8184): Launched 10:25:28.391063 run osmo-stp_10.42.42.5(pid=8181): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8181)] 10:25:28.529053 run osmo-stp_10.42.42.5(pid=8181): stdout: | (launched: 2022-12-14_10:25:27.063602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:28.668772 run osmo-stp_10.42.42.5(pid=8181): stderr: | 20221214102527252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102527252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102527252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102527252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102527253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102527253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102527253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:28.807937 run osmo-stp_10.42.42.5(pid=8181): stdout: | (launched: 2022-12-14_10:25:27.063602) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:28.941140 run osmo-stp_10.42.42.5(pid=8181): stderr: | 20221214102527252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102527252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102527252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102527252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102527253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102527253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102527253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:29.098732 run patchelf(pid=8184): Terminating (SIGINT) 10:25:29.281772 run patchelf(pid=8184): Terminated: ok {rc=0} 10:25:29.413790 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8181): Process ended prematurely: osmo-stp_10.42.42.5(pid=8181) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8181)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 10:25:29.424264 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:25:29.453396 run osmo-hlr_10.42.42.2(pid=8178): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8178)] 10:25:29.503675 run osmo-hlr_10.42.42.2(pid=8178): stdout: | (launched: 2022-12-14_10:25:26.050473) 10:25:29.556349 run osmo-hlr_10.42.42.2(pid=8178): stderr: | 20221214102526247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102526247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102526247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102526247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102526247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102526247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102526259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102526270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102526270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102526270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:29.609349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8167): Terminating (SIGTERM) 10:25:29.651452 run iperf3-srv_10.42.42.10(pid=8168): Terminating (SIGTERM) 10:25:29.693895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8169): Terminating (SIGTERM) 10:25:29.735854 run iperf3-srv_10.42.42.10(pid=8170): Terminating (SIGTERM) 10:25:29.777694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8171): Terminating (SIGTERM) 10:25:29.820185 run iperf3-srv_10.42.42.10(pid=8172): Terminating (SIGTERM) 10:25:29.862503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8173): Terminating (SIGTERM) 10:25:29.904328 run iperf3-srv_10.42.42.10(pid=8174): Terminating (SIGTERM) 10:25:29.946716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8177): Terminating (SIGTERM) 10:25:29.989039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8180): Terminating (SIGTERM) 10:25:30.031084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8183): Terminating (SIGTERM) 10:25:30.073502 --- ParallelTerminationStrategy: PID 8167 died... 10:25:30.093993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8167): Terminated: ok {rc=0} 10:25:30.140556 --- ParallelTerminationStrategy: PID 8168 died... 10:25:30.160400 run iperf3-srv_10.42.42.10(pid=8168): Terminated {rc=256} 10:25:30.206758 --- ParallelTerminationStrategy: PID 8169 died... 10:25:30.226581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8169): Terminated: ok {rc=0} 10:25:30.272901 --- ParallelTerminationStrategy: PID 8170 died... 10:25:30.292928 run iperf3-srv_10.42.42.10(pid=8170): Terminated {rc=256} 10:25:30.339328 --- ParallelTerminationStrategy: PID 8171 died... 10:25:30.359169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8171): Terminated: ok {rc=0} 10:25:30.405578 --- ParallelTerminationStrategy: PID 8172 died... 10:25:30.425423 run iperf3-srv_10.42.42.10(pid=8172): Terminated {rc=256} 10:25:30.471760 --- ParallelTerminationStrategy: PID 8173 died... 10:25:30.491528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8173): Terminated: ok {rc=0} 10:25:30.537747 --- ParallelTerminationStrategy: PID 8174 died... 10:25:30.557606 run iperf3-srv_10.42.42.10(pid=8174): Terminated {rc=256} 10:25:30.603943 --- ParallelTerminationStrategy: PID 8177 died... 10:25:30.623819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8177): Terminated: ok {rc=0} 10:25:30.670224 --- ParallelTerminationStrategy: PID 8180 died... 10:25:30.690106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8180): Terminated: ok {rc=0} 10:25:30.736391 --- ParallelTerminationStrategy: PID 8183 died... 10:25:30.756430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8183): Terminated: ok {rc=0} 10:25:30.845755 bus /gobi_4: Setting Powered False 10:25:31.968475 bus /gobi_4: Setting Powered False 10:25:33.101931 bus /gobi_1: Setting Powered False 10:25:34.201084 bus /gobi_1: Setting Powered False 10:25:35.317402 bus /gobi_0: Setting Powered False 10:25:36.414202 bus /gobi_0: Setting Powered False 10:25:37.530961 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 10:25:38.637130 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:38.649605 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:25:38.703607 tst ping.py: using LAC 40281 10:25:38.828791 tst ping.py: using RAC 246 10:25:38.955363 tst ping.py: using CellId 40281 10:25:39.083210 tst ping.py: using BVCI 40282 10:25:39.199972 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:39.211546 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:39.222819 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:39.234119 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:39.245324 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:39.256544 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:39.267982 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:39.279200 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:25:39.398129 tst ping.py:19: start network... 10:25:39.613394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:40.107541 run create_hlr_db(pid=8186): Launched 10:25:40.237813 bus /gobi_6: Setting Powered False 10:25:41.302729 run create_hlr_db(pid=8186): Terminated: ok {rc=0} 10:25:41.735956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8188): Launched 10:25:42.037257 run osmo-hlr_10.42.42.2(pid=8189): Launched 10:25:42.152011 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:42.683624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8191): Launched 10:25:42.982724 run osmo-stp_10.42.42.5(pid=8192): Launched 10:25:43.098320 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:25:43.615467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8194): Launched 10:25:43.732217 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:25:43.985614 run patchelf(pid=8195): Launched 10:25:44.152437 run osmo-stp_10.42.42.5(pid=8192): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8192)] 10:25:44.279994 run osmo-stp_10.42.42.5(pid=8192): stdout: | (launched: 2022-12-14_10:25:42.927821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:44.409748 run osmo-stp_10.42.42.5(pid=8192): stderr: | 20221214102543097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102543097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102543098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102543098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102543098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102543099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102543099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:44.539451 run osmo-stp_10.42.42.5(pid=8192): stdout: | (launched: 2022-12-14_10:25:42.927821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:44.662415 run osmo-stp_10.42.42.5(pid=8192): stderr: | 20221214102543097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102543097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102543098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102543098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102543098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102543099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102543099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:44.808130 run patchelf(pid=8195): Terminating (SIGINT) 10:25:44.977375 run patchelf(pid=8195): Terminated: ok {rc=0} 10:25:45.099826 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8192): Process ended prematurely: osmo-stp_10.42.42.5(pid=8192) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8192)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 10:25:45.109397 tst ping.py:22: Test FAILED (6.5 sec) 10:25:45.136463 run osmo-hlr_10.42.42.2(pid=8189): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8189)] 10:25:45.185161 run osmo-hlr_10.42.42.2(pid=8189): stdout: | (launched: 2022-12-14_10:25:41.982049) 10:25:45.235314 run osmo-hlr_10.42.42.2(pid=8189): stderr: | 20221214102542156 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102542156 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102542156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102542156 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102542156 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102542156 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102542169 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102542177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102542177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102542177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:45.285686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8188): Terminating (SIGTERM) 10:25:45.326206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8191): Terminating (SIGTERM) 10:25:45.366406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8194): Terminating (SIGTERM) 10:25:45.406921 --- ParallelTerminationStrategy: PID 8188 died... 10:25:45.426582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8188): Terminated: ok {rc=0} 10:25:45.471171 --- ParallelTerminationStrategy: PID 8191 died... 10:25:45.490189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8191): Terminated: ok {rc=0} 10:25:45.534627 --- ParallelTerminationStrategy: PID 8194 died... 10:25:45.553828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8194): Terminated: ok {rc=0} 10:25:45.640528 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:25:46.733404 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:46.746887 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:25:46.802088 tst ping_idle_ping.py: using LAC 40282 10:25:46.929646 tst ping_idle_ping.py: using RAC 247 10:25:47.058290 tst ping_idle_ping.py: using CellId 40282 10:25:47.192286 tst ping_idle_ping.py: using BVCI 40283 10:25:47.302324 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:47.313400 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:47.324074 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:47.334839 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:47.345901 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:47.356847 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:47.368087 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:25:47.379139 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:25:47.499310 tst ping_idle_ping.py:24: start network... 10:25:47.716640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:48.215451 run create_hlr_db(pid=8196): Launched 10:25:48.346428 bus /gobi_6: Setting Powered False 10:25:49.411132 run create_hlr_db(pid=8196): Terminated: ok {rc=0} 10:25:49.842597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8198): Launched 10:25:50.146358 run osmo-hlr_10.42.42.2(pid=8199): Launched 10:25:50.261844 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:50.791977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8201): Launched 10:25:51.092799 run osmo-stp_10.42.42.5(pid=8202): Launched 10:25:51.208146 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:25:51.727967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8204): Launched 10:25:51.844670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:25:52.102199 run patchelf(pid=8209): Launched 10:25:52.270178 run osmo-stp_10.42.42.5(pid=8202): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8202)] 10:25:52.398179 run osmo-stp_10.42.42.5(pid=8202): stdout: | (launched: 2022-12-14_10:25:51.037487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:52.528036 run osmo-stp_10.42.42.5(pid=8202): stderr: | 20221214102551203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102551203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102551204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102551204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102551204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102551205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102551205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:52.657733 run osmo-stp_10.42.42.5(pid=8202): stdout: | (launched: 2022-12-14_10:25:51.037487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:52.780781 run osmo-stp_10.42.42.5(pid=8202): stderr: | 20221214102551203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102551203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102551204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102551204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102551204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102551205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102551205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:52.926912 run patchelf(pid=8209): Terminating (SIGINT) 10:25:53.096045 run patchelf(pid=8209): Terminated: ok {rc=0} 10:25:53.218642 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8202): Process ended prematurely: osmo-stp_10.42.42.5(pid=8202) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8202)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 10:25:53.227744 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:25:53.254905 run osmo-hlr_10.42.42.2(pid=8199): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8199)] 10:25:53.303715 run osmo-hlr_10.42.42.2(pid=8199): stdout: | (launched: 2022-12-14_10:25:50.090944) 10:25:53.354033 run osmo-hlr_10.42.42.2(pid=8199): stderr: | 20221214102550265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102550265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102550265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102550265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102550265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102550265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102550277 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102550286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102550286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102550286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:53.404756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8198): Terminating (SIGTERM) 10:25:53.445326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8201): Terminating (SIGTERM) 10:25:53.486393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8204): Terminating (SIGTERM) 10:25:53.527084 --- ParallelTerminationStrategy: PID 8198 died... 10:25:53.546898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8198): Terminated: ok {rc=0} 10:25:53.591701 --- ParallelTerminationStrategy: PID 8201 died... 10:25:53.610811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8201): Terminated: ok {rc=0} 10:25:53.655241 --- ParallelTerminationStrategy: PID 8204 died... 10:25:53.674473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8204): Terminated: ok {rc=0} 10:25:53.762105 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:25:55.077837 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:25:55.084175 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:25:55.117654 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:25:55.157205 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:25:55.241782 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:25:55.274570 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:25:55.312406 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:25:55.909423 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:25:55.958923 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:25:55.969935 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:25:56.038026 tst cs_paging_gprs_active.py: using LAC 40283 10:25:56.156544 tst cs_paging_gprs_active.py: using RAC 248 10:25:56.275408 tst cs_paging_gprs_active.py: using CellId 40283 10:25:56.394146 tst cs_paging_gprs_active.py: using BVCI 40284 10:25:56.507349 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:25:56.518428 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:25:56.529375 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:25:56.540096 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:25:56.551283 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:25:56.562414 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:25:56.573690 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:25:56.584647 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:25:56.595858 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:25:56.716888 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:25:56.836213 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:25:57.042020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:25:57.350130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8213): Launched 10:25:57.618068 run iperf3-srv_10.42.42.10(pid=8214): Launched 10:25:57.733665 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:25:57.939389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:25:58.247796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8215): Launched 10:25:58.516208 run iperf3-srv_10.42.42.10(pid=8216): Launched 10:25:58.631897 tst cs_paging_gprs_active.py:38: start network... 10:25:58.836539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:59.311505 run create_hlr_db(pid=8217): Launched 10:25:59.428713 bus /gobi_6: Setting Powered False 10:26:00.490470 run create_hlr_db(pid=8217): Terminated: ok {rc=0} 10:26:00.930556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8219): Launched 10:26:01.298088 run osmo-hlr_10.42.42.2(pid=8220): Launched 10:26:01.521506 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:02.399156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8222): Launched 10:26:02.718774 run osmo-stp_10.42.42.5(pid=8223): Launched 10:26:02.838328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:26:03.365060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8225): Launched 10:26:03.482700 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:26:03.740911 run patchelf(pid=8226): Launched 10:26:03.912338 run osmo-stp_10.42.42.5(pid=8223): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8223)] 10:26:04.043279 run osmo-stp_10.42.42.5(pid=8223): stdout: | (launched: 2022-12-14_10:26:02.662568) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:04.175166 run osmo-stp_10.42.42.5(pid=8223): stderr: | 20221214102602831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102602831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102602831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102602832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102602832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102602832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102602832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:04.306978 run osmo-stp_10.42.42.5(pid=8223): stdout: | (launched: 2022-12-14_10:26:02.662568) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:04.432687 run osmo-stp_10.42.42.5(pid=8223): stderr: | 20221214102602831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102602831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102602831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102602832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102602832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102602832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102602832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:04.581927 run patchelf(pid=8226): Terminating (SIGINT) 10:26:04.754686 run patchelf(pid=8226): Terminated: ok {rc=0} 10:26:04.878650 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8223): Process ended prematurely: osmo-stp_10.42.42.5(pid=8223) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8223)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:26:04.888278 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 10:26:04.915573 run osmo-hlr_10.42.42.2(pid=8220): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8220)] 10:26:04.963814 run osmo-hlr_10.42.42.2(pid=8220): stdout: | (launched: 2022-12-14_10:26:01.227192) 10:26:05.013485 run osmo-hlr_10.42.42.2(pid=8220): stderr: | 20221214102601595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102601595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102601595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102601595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102601595 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102601595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102601618 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102601635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102601635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102601635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:05.063867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8213): Terminating (SIGTERM) 10:26:05.104335 run iperf3-srv_10.42.42.10(pid=8214): Terminating (SIGTERM) 10:26:05.144637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8215): Terminating (SIGTERM) 10:26:05.184896 run iperf3-srv_10.42.42.10(pid=8216): Terminating (SIGTERM) 10:26:05.225114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8219): Terminating (SIGTERM) 10:26:05.265310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8222): Terminating (SIGTERM) 10:26:05.305457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8225): Terminating (SIGTERM) 10:26:05.345912 --- ParallelTerminationStrategy: PID 8213 died... 10:26:05.365597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8213): Terminated: ok {rc=0} 10:26:05.409754 --- ParallelTerminationStrategy: PID 8214 died... 10:26:05.428725 run iperf3-srv_10.42.42.10(pid=8214): Terminated {rc=256} 10:26:05.472899 --- ParallelTerminationStrategy: PID 8215 died... 10:26:05.492238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8215): Terminated: ok {rc=0} 10:26:05.536191 --- ParallelTerminationStrategy: PID 8216 died... 10:26:05.555158 run iperf3-srv_10.42.42.10(pid=8216): Terminated {rc=256} 10:26:05.599135 --- ParallelTerminationStrategy: PID 8219 died... 10:26:05.618118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8219): Terminated: ok {rc=0} 10:26:05.661971 --- ParallelTerminationStrategy: PID 8222 died... 10:26:05.680870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8222): Terminated: ok {rc=0} 10:26:05.725061 --- ParallelTerminationStrategy: PID 8225 died... 10:26:05.744003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8225): Terminated: ok {rc=0} 10:26:05.828773 bus /gobi_0: Setting Powered False 10:26:06.924860 bus /gobi_0: Setting Powered False 10:26:08.041213 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:26:09.188250 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:09.200014 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:26:09.273091 tst iperf3.py: using LAC 40284 10:26:09.392789 tst iperf3.py: using RAC 249 10:26:09.512680 tst iperf3.py: using CellId 40284 10:26:09.633794 tst iperf3.py: using BVCI 40285 10:26:09.744793 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:09.755840 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:09.766747 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:09.777627 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:09.788676 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:09.799914 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:09.811241 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:09.822356 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:09.834317 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:26:09.955899 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:26:10.176259 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:26:10.502889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8227): Launched 10:26:10.789484 run iperf3-srv_10.42.42.10(pid=8228): Launched 10:26:10.913391 tst iperf3.py:8: start network... 10:26:11.132596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:11.638000 run create_hlr_db(pid=8229): Launched 10:26:11.773186 bus /gobi_6: Setting Powered False 10:26:12.837679 run create_hlr_db(pid=8229): Terminated: ok {rc=0} 10:26:13.274886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8231): Launched 10:26:13.583674 run osmo-hlr_10.42.42.2(pid=8232): Launched 10:26:13.704332 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:14.247653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8234): Launched 10:26:14.553789 run osmo-stp_10.42.42.5(pid=8235): Launched 10:26:14.672277 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:26:15.199550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8237): Launched 10:26:15.317779 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:26:15.577257 run patchelf(pid=8238): Launched 10:26:15.749470 run osmo-stp_10.42.42.5(pid=8235): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8235)] 10:26:15.884708 run osmo-stp_10.42.42.5(pid=8235): stdout: | (launched: 2022-12-14_10:26:14.497848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:16.037598 run osmo-stp_10.42.42.5(pid=8235): stderr: | 20221214102614666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102614666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102614666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102614666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102614667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102614667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102614667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:16.181487 run osmo-stp_10.42.42.5(pid=8235): stdout: | (launched: 2022-12-14_10:26:14.497848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:16.319242 run osmo-stp_10.42.42.5(pid=8235): stderr: | 20221214102614666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102614666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102614666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102614666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102614667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102614667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102614667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:16.482722 run patchelf(pid=8238): Terminating (SIGINT) 10:26:16.672699 run patchelf(pid=8238): Terminated: ok {rc=0} 10:26:16.809360 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8235): Process ended prematurely: osmo-stp_10.42.42.5(pid=8235) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8235)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 10:26:16.820201 tst iperf3.py:8: Test FAILED (7.7 sec) 10:26:16.850469 run osmo-hlr_10.42.42.2(pid=8232): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8232)] 10:26:16.902001 run osmo-hlr_10.42.42.2(pid=8232): stdout: | (launched: 2022-12-14_10:26:13.527251) 10:26:16.955250 run osmo-hlr_10.42.42.2(pid=8232): stderr: | 20221214102613703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102613703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102613703 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102613703 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102613704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102613704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102613716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102613725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102613725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102613725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:17.010209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8227): Terminating (SIGTERM) 10:26:17.054523 run iperf3-srv_10.42.42.10(pid=8228): Terminating (SIGTERM) 10:26:17.099369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8231): Terminating (SIGTERM) 10:26:17.142844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8234): Terminating (SIGTERM) 10:26:17.187665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8237): Terminating (SIGTERM) 10:26:17.230454 --- ParallelTerminationStrategy: PID 8227 died... 10:26:17.250567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8227): Terminated: ok {rc=0} 10:26:17.297604 --- ParallelTerminationStrategy: PID 8228 died... 10:26:17.317254 run iperf3-srv_10.42.42.10(pid=8228): Terminated {rc=256} 10:26:17.363625 --- ParallelTerminationStrategy: PID 8231 died... 10:26:17.383311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8231): Terminated: ok {rc=0} 10:26:17.429611 --- ParallelTerminationStrategy: PID 8234 died... 10:26:17.449376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8234): Terminated: ok {rc=0} 10:26:17.495717 --- ParallelTerminationStrategy: PID 8237 died... 10:26:17.515369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8237): Terminated: ok {rc=0} 10:26:17.604576 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:26:18.755807 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:18.768191 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:26:18.841086 tst iperf3m4.py: using LAC 40285 10:26:18.969190 tst iperf3m4.py: using RAC 250 10:26:19.097387 tst iperf3m4.py: using CellId 40285 10:26:19.224925 tst iperf3m4.py: using BVCI 40286 10:26:19.344203 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:19.355994 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:19.367489 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:19.379030 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:19.390615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:19.402193 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:19.413832 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:19.425283 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:19.437049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:26:19.555994 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:26:19.678171 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:26:19.800657 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:26:19.917797 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:26:20.123683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:26:20.431112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8239): Launched 10:26:20.699325 run iperf3-srv_10.42.42.10(pid=8240): Launched 10:26:20.814866 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:26:21.019616 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:26:21.327089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8241): Launched 10:26:21.594611 run iperf3-srv_10.42.42.10(pid=8242): Launched 10:26:21.711845 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:26:21.915986 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:26:22.224190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8243): Launched 10:26:22.491989 run iperf3-srv_10.42.42.10(pid=8244): Launched 10:26:22.607343 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:26:22.812009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:26:23.119371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8245): Launched 10:26:23.386842 run iperf3-srv_10.42.42.10(pid=8246): Launched 10:26:23.501835 tst iperf3m4.py:8: start network... 10:26:23.706024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:24.179530 run create_hlr_db(pid=8247): Launched 10:26:24.297301 bus /gobi_6: Setting Powered False 10:26:25.357794 run create_hlr_db(pid=8247): Terminated: ok {rc=0} 10:26:25.784591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8249): Launched 10:26:26.091763 run osmo-hlr_10.42.42.2(pid=8250): Launched 10:26:26.208273 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:26.747201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8252): Launched 10:26:27.054025 run osmo-stp_10.42.42.5(pid=8253): Launched 10:26:27.171563 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:26:27.699310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8255): Launched 10:26:27.818267 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:26:28.076596 run patchelf(pid=8256): Launched 10:26:28.247238 run osmo-stp_10.42.42.5(pid=8253): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8253)] 10:26:28.376029 run osmo-stp_10.42.42.5(pid=8253): stdout: | (launched: 2022-12-14_10:26:26.997682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:28.506830 run osmo-stp_10.42.42.5(pid=8253): stderr: | 20221214102627165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102627165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102627165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102627165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102627166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102627166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102627166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:28.637773 run osmo-stp_10.42.42.5(pid=8253): stdout: | (launched: 2022-12-14_10:26:26.997682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:28.762589 run osmo-stp_10.42.42.5(pid=8253): stderr: | 20221214102627165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102627165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102627165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102627165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102627166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102627166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102627166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:28.910407 run patchelf(pid=8256): Terminating (SIGINT) 10:26:29.081963 run patchelf(pid=8256): Terminated: ok {rc=0} 10:26:29.206053 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8253): Process ended prematurely: osmo-stp_10.42.42.5(pid=8253) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8253)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:26:29.215733 tst iperf3m4.py:8: Test FAILED (10.5 sec) 10:26:29.243356 run osmo-hlr_10.42.42.2(pid=8250): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8250)] 10:26:29.292094 run osmo-hlr_10.42.42.2(pid=8250): stdout: | (launched: 2022-12-14_10:26:26.035296) 10:26:29.342513 run osmo-hlr_10.42.42.2(pid=8250): stderr: | 20221214102626207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102626208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102626208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102626208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102626208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102626208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102626220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102626228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102626228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102626228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:29.392939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8239): Terminating (SIGTERM) 10:26:29.433433 run iperf3-srv_10.42.42.10(pid=8240): Terminating (SIGTERM) 10:26:29.473933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8241): Terminating (SIGTERM) 10:26:29.514303 run iperf3-srv_10.42.42.10(pid=8242): Terminating (SIGTERM) 10:26:29.554625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8243): Terminating (SIGTERM) 10:26:29.595054 run iperf3-srv_10.42.42.10(pid=8244): Terminating (SIGTERM) 10:26:29.635293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8245): Terminating (SIGTERM) 10:26:29.675754 run iperf3-srv_10.42.42.10(pid=8246): Terminating (SIGTERM) 10:26:29.716103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8249): Terminating (SIGTERM) 10:26:29.756620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8252): Terminating (SIGTERM) 10:26:29.797058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8255): Terminating (SIGTERM) 10:26:29.837781 --- ParallelTerminationStrategy: PID 8239 died... 10:26:29.857619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8239): Terminated: ok {rc=0} 10:26:29.902306 --- ParallelTerminationStrategy: PID 8240 died... 10:26:29.921332 run iperf3-srv_10.42.42.10(pid=8240): Terminated {rc=256} 10:26:29.965890 --- ParallelTerminationStrategy: PID 8241 died... 10:26:29.985079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8241): Terminated: ok {rc=0} 10:26:30.029594 --- ParallelTerminationStrategy: PID 8242 died... 10:26:30.048549 run iperf3-srv_10.42.42.10(pid=8242): Terminated {rc=256} 10:26:30.092810 --- ParallelTerminationStrategy: PID 8243 died... 10:26:30.112441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8243): Terminated: ok {rc=0} 10:26:30.156863 --- ParallelTerminationStrategy: PID 8244 died... 10:26:30.176542 run iperf3-srv_10.42.42.10(pid=8244): Terminated {rc=256} 10:26:30.221199 --- ParallelTerminationStrategy: PID 8245 died... 10:26:30.240352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8245): Terminated: ok {rc=0} 10:26:30.284930 --- ParallelTerminationStrategy: PID 8246 died... 10:26:30.304161 run iperf3-srv_10.42.42.10(pid=8246): Terminated {rc=256} 10:26:30.348486 --- ParallelTerminationStrategy: PID 8249 died... 10:26:30.367627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8249): Terminated: ok {rc=0} 10:26:30.412123 --- ParallelTerminationStrategy: PID 8252 died... 10:26:30.431242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8252): Terminated: ok {rc=0} 10:26:30.475667 --- ParallelTerminationStrategy: PID 8255 died... 10:26:30.494877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8255): Terminated: ok {rc=0} 10:26:30.579565 bus /gobi_4: Setting Powered False 10:26:31.686776 bus /gobi_4: Setting Powered False 10:26:32.810307 bus /gobi_1: Setting Powered False 10:26:33.909210 bus /gobi_1: Setting Powered False 10:26:35.026548 bus /gobi_0: Setting Powered False 10:26:36.127194 bus /gobi_0: Setting Powered False 10:26:37.245338 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:26:38.349444 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:38.361781 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:26:38.436197 tst ping.py: using LAC 40286 10:26:38.561474 tst ping.py: using RAC 251 10:26:38.679704 tst ping.py: using CellId 40286 10:26:38.801409 tst ping.py: using BVCI 40287 10:26:38.911373 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:38.922776 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:38.933959 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:38.944898 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:38.956198 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:38.967441 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:38.978887 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:38.990197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:26:39.108756 tst ping.py:19: start network... 10:26:39.323812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:39.816002 run create_hlr_db(pid=8257): Launched 10:26:39.947449 bus /gobi_6: Setting Powered False 10:26:41.010942 run create_hlr_db(pid=8257): Terminated: ok {rc=0} 10:26:41.438991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8259): Launched 10:26:41.739637 run osmo-hlr_10.42.42.2(pid=8260): Launched 10:26:41.853646 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:42.387538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8262): Launched 10:26:42.688307 run osmo-stp_10.42.42.5(pid=8263): Launched 10:26:42.803093 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:26:43.320040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8265): Launched 10:26:43.435210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:26:43.688492 run patchelf(pid=8266): Launched 10:26:43.855850 run osmo-stp_10.42.42.5(pid=8263): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8263)] 10:26:43.983322 run osmo-stp_10.42.42.5(pid=8263): stdout: | (launched: 2022-12-14_10:26:42.633189) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:44.112664 run osmo-stp_10.42.42.5(pid=8263): stderr: | 20221214102642802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102642802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102642802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102642802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102642803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102642803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102642803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:44.242175 run osmo-stp_10.42.42.5(pid=8263): stdout: | (launched: 2022-12-14_10:26:42.633189) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:44.365115 run osmo-stp_10.42.42.5(pid=8263): stderr: | 20221214102642802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102642802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102642802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102642802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102642803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102642803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102642803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:44.510543 run patchelf(pid=8266): Terminating (SIGINT) 10:26:44.679428 run patchelf(pid=8266): Terminated: ok {rc=0} 10:26:44.801388 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8263): Process ended prematurely: osmo-stp_10.42.42.5(pid=8263) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8263)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 10:26:44.810637 tst ping.py:22: Test FAILED (6.5 sec) 10:26:44.837753 run osmo-hlr_10.42.42.2(pid=8260): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8260)] 10:26:44.886790 run osmo-hlr_10.42.42.2(pid=8260): stdout: | (launched: 2022-12-14_10:26:41.684551) 10:26:44.937378 run osmo-hlr_10.42.42.2(pid=8260): stderr: | 20221214102641859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102641860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102641860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102641860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102641860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102641860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102641871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102641880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102641880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102641881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:44.987873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8259): Terminating (SIGTERM) 10:26:45.028320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8262): Terminating (SIGTERM) 10:26:45.068900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8265): Terminating (SIGTERM) 10:26:45.109832 --- ParallelTerminationStrategy: PID 8259 died... 10:26:45.129744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8259): Terminated: ok {rc=0} 10:26:45.174568 --- ParallelTerminationStrategy: PID 8262 died... 10:26:45.193976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8262): Terminated: ok {rc=0} 10:26:45.238729 --- ParallelTerminationStrategy: PID 8265 died... 10:26:45.258211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8265): Terminated: ok {rc=0} 10:26:45.342840 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:26:46.432857 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:46.448394 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:26:46.523977 tst ping_idle_ping.py: using LAC 40287 10:26:46.663644 tst ping_idle_ping.py: using RAC 252 10:26:46.792518 tst ping_idle_ping.py: using CellId 40287 10:26:46.917888 tst ping_idle_ping.py: using BVCI 40288 10:26:47.031226 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:47.043430 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:47.055509 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:47.068306 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:47.081874 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:47.094964 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:47.108221 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:26:47.122750 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:26:47.249103 tst ping_idle_ping.py:24: start network... 10:26:47.465726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:47.971387 run create_hlr_db(pid=8267): Launched 10:26:48.104785 bus /gobi_6: Setting Powered False 10:26:49.169571 run create_hlr_db(pid=8267): Terminated: ok {rc=0} 10:26:49.620732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8269): Launched 10:26:49.943634 run osmo-hlr_10.42.42.2(pid=8270): Launched 10:26:50.067109 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:50.626048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8272): Launched 10:26:50.946348 run osmo-stp_10.42.42.5(pid=8273): Launched 10:26:51.068918 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:26:51.622894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8275): Launched 10:26:51.747169 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:26:52.018027 run patchelf(pid=8276): Launched 10:26:52.199598 run osmo-stp_10.42.42.5(pid=8273): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8273)] 10:26:52.335738 run osmo-stp_10.42.42.5(pid=8273): stdout: | (launched: 2022-12-14_10:26:50.887931) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:52.473846 run osmo-stp_10.42.42.5(pid=8273): stderr: | 20221214102651079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102651079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102651079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102651079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102651080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102651080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102651080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:52.611763 run osmo-stp_10.42.42.5(pid=8273): stdout: | (launched: 2022-12-14_10:26:50.887931) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:52.743180 run osmo-stp_10.42.42.5(pid=8273): stderr: | 20221214102651079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102651079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102651079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102651079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102651080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102651080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102651080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:52.898476 run patchelf(pid=8276): Terminating (SIGINT) 10:26:53.078612 run patchelf(pid=8276): Terminated: ok {rc=0} 10:26:53.208894 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8273): Process ended prematurely: osmo-stp_10.42.42.5(pid=8273) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8273)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:26:53.218768 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:26:53.247000 run osmo-hlr_10.42.42.2(pid=8270): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8270)] 10:26:53.297981 run osmo-hlr_10.42.42.2(pid=8270): stdout: | (launched: 2022-12-14_10:26:49.884844) 10:26:53.350621 run osmo-hlr_10.42.42.2(pid=8270): stderr: | 20221214102650081 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102650082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102650082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102650082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102650082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102650082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102650095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102650103 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102650103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102650103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:53.404149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8269): Terminating (SIGTERM) 10:26:53.446404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8272): Terminating (SIGTERM) 10:26:53.488646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8275): Terminating (SIGTERM) 10:26:53.531307 --- ParallelTerminationStrategy: PID 8269 died... 10:26:53.551439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8269): Terminated: ok {rc=0} 10:26:53.597917 --- ParallelTerminationStrategy: PID 8272 died... 10:26:53.617764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8272): Terminated: ok {rc=0} 10:26:53.664165 --- ParallelTerminationStrategy: PID 8275 died... 10:26:53.683901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8275): Terminated: ok {rc=0} 10:26:53.771850 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:26:55.085657 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:26:55.092393 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:26:55.126741 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:26:55.166364 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:26:55.255246 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:26:55.289613 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:26:55.328679 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:26:55.926976 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:26:55.979902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:26:55.991650 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:26:56.064910 tst cs_paging_gprs_active.py: using LAC 40288 10:26:56.194815 tst cs_paging_gprs_active.py: using RAC 253 10:26:56.323650 tst cs_paging_gprs_active.py: using CellId 40288 10:26:56.455039 tst cs_paging_gprs_active.py: using BVCI 40289 10:26:56.574631 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:26:56.586738 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:26:56.598341 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:26:56.610180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:26:56.621955 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:26:56.633718 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:26:56.645648 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:26:56.657261 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:26:56.669236 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:26:56.789290 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:26:56.907640 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:26:57.114244 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:26:57.422399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8280): Launched 10:26:57.692313 run iperf3-srv_10.42.42.10(pid=8281): Launched 10:26:57.807424 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:26:58.012819 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:26:58.321585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8282): Launched 10:26:58.590247 run iperf3-srv_10.42.42.10(pid=8283): Launched 10:26:58.707486 tst cs_paging_gprs_active.py:38: start network... 10:26:58.912539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:59.387786 run create_hlr_db(pid=8284): Launched 10:26:59.506857 bus /gobi_6: Setting Powered False 10:27:00.567610 run create_hlr_db(pid=8284): Terminated: ok {rc=0} 10:27:01.045735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8286): Launched 10:27:01.387956 run osmo-hlr_10.42.42.2(pid=8287): Launched 10:27:01.756479 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:02.355544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8289): Launched 10:27:02.685591 run osmo-stp_10.42.42.5(pid=8290): Launched 10:27:02.811139 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:27:03.374032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8292): Launched 10:27:03.501891 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:27:03.778135 run patchelf(pid=8293): Launched 10:27:03.961892 run osmo-stp_10.42.42.5(pid=8290): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8290)] 10:27:04.100483 run osmo-stp_10.42.42.5(pid=8290): stdout: | (launched: 2022-12-14_10:27:02.625867) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:04.240202 run osmo-stp_10.42.42.5(pid=8290): stderr: | 20221214102702817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102702817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102702817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102702818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102702818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102702818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102702818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:04.381038 run osmo-stp_10.42.42.5(pid=8290): stdout: | (launched: 2022-12-14_10:27:02.625867) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:04.514747 run osmo-stp_10.42.42.5(pid=8290): stderr: | 20221214102702817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102702817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102702817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102702818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102702818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102702818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102702818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:04.673942 run patchelf(pid=8293): Terminating (SIGINT) 10:27:04.857557 run patchelf(pid=8293): Terminated: ok {rc=0} 10:27:04.989728 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8290): Process ended prematurely: osmo-stp_10.42.42.5(pid=8290) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8290)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:27:05.000104 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 10:27:05.029039 run osmo-hlr_10.42.42.2(pid=8287): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8287)] 10:27:05.080198 run osmo-hlr_10.42.42.2(pid=8287): stdout: | (launched: 2022-12-14_10:27:01.325844) 10:27:05.132307 run osmo-hlr_10.42.42.2(pid=8287): stderr: | 20221214102701591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102701591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102701591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102701591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102701591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102701591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102701611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102701631 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102701631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102701631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:05.185240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8280): Terminating (SIGTERM) 10:27:05.227697 run iperf3-srv_10.42.42.10(pid=8281): Terminating (SIGTERM) 10:27:05.269905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8282): Terminating (SIGTERM) 10:27:05.314421 run iperf3-srv_10.42.42.10(pid=8283): Terminating (SIGTERM) 10:27:05.354906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8286): Terminating (SIGTERM) 10:27:05.395037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8289): Terminating (SIGTERM) 10:27:05.435257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8292): Terminating (SIGTERM) 10:27:05.475628 --- ParallelTerminationStrategy: PID 8280 died... 10:27:05.495215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8280): Terminated: ok {rc=0} 10:27:05.539683 --- ParallelTerminationStrategy: PID 8281 died... 10:27:05.558615 run iperf3-srv_10.42.42.10(pid=8281): Terminated {rc=256} 10:27:05.603893 --- ParallelTerminationStrategy: PID 8282 died... 10:27:05.622881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8282): Terminated: ok {rc=0} 10:27:05.667345 --- ParallelTerminationStrategy: PID 8283 died... 10:27:05.686299 run iperf3-srv_10.42.42.10(pid=8283): Terminated {rc=256} 10:27:05.730718 --- ParallelTerminationStrategy: PID 8286 died... 10:27:05.749698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8286): Terminated: ok {rc=0} 10:27:05.794249 --- ParallelTerminationStrategy: PID 8289 died... 10:27:05.813369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8289): Terminated: ok {rc=0} 10:27:05.857995 --- ParallelTerminationStrategy: PID 8292 died... 10:27:05.876820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8292): Terminated: ok {rc=0} 10:27:05.963942 bus /gobi_0: Setting Powered False 10:27:07.061901 bus /gobi_0: Setting Powered False 10:27:08.177531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:27:09.323787 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:09.335411 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:27:09.409170 tst iperf3.py: using LAC 40289 10:27:09.529150 tst iperf3.py: using RAC 254 10:27:09.649185 tst iperf3.py: using CellId 40289 10:27:09.771340 tst iperf3.py: using BVCI 40290 10:27:09.883603 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:09.894618 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:09.905428 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:09.916154 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:09.927270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:09.938430 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:09.950130 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:09.961113 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:09.972371 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:27:10.088763 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:27:10.295578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:27:10.605016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8296): Launched 10:27:10.873342 run iperf3-srv_10.42.42.10(pid=8297): Launched 10:27:10.989135 tst iperf3.py:8: start network... 10:27:11.194615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:11.669815 run create_hlr_db(pid=8298): Launched 10:27:11.787533 bus /gobi_6: Setting Powered False 10:27:12.848283 run create_hlr_db(pid=8298): Terminated: ok {rc=0} 10:27:13.296011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8300): Launched 10:27:13.623529 run osmo-hlr_10.42.42.2(pid=8301): Launched 10:27:13.749699 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:14.310902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8303): Launched 10:27:14.639011 run osmo-stp_10.42.42.5(pid=8304): Launched 10:27:14.763173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:27:15.324670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8306): Launched 10:27:15.450087 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:27:15.726252 run patchelf(pid=8307): Launched 10:27:15.921680 run osmo-stp_10.42.42.5(pid=8304): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8304)] 10:27:16.063074 run osmo-stp_10.42.42.5(pid=8304): stdout: | (launched: 2022-12-14_10:27:14.578793) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:16.200099 run osmo-stp_10.42.42.5(pid=8304): stderr: | 20221214102714769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102714769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102714770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102714770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102714770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102714771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102714771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:16.337815 run osmo-stp_10.42.42.5(pid=8304): stdout: | (launched: 2022-12-14_10:27:14.578793) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:16.469880 run osmo-stp_10.42.42.5(pid=8304): stderr: | 20221214102714769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102714769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102714770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102714770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102714770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102714771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102714771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:16.626710 run patchelf(pid=8307): Terminating (SIGINT) 10:27:16.806004 run patchelf(pid=8307): Terminated: ok {rc=0} 10:27:16.936653 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8304): Process ended prematurely: osmo-stp_10.42.42.5(pid=8304) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8304)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 10:27:16.947800 tst iperf3.py:8: Test FAILED (7.7 sec) 10:27:16.976463 run osmo-hlr_10.42.42.2(pid=8301): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8301)] 10:27:17.031200 run osmo-hlr_10.42.42.2(pid=8301): stdout: | (launched: 2022-12-14_10:27:13.563488) 10:27:17.084577 run osmo-hlr_10.42.42.2(pid=8301): stderr: | 20221214102713760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102713760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102713760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102713761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102713761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102713761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102713773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102713782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102713782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102713782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:17.138790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8296): Terminating (SIGTERM) 10:27:17.180932 run iperf3-srv_10.42.42.10(pid=8297): Terminating (SIGTERM) 10:27:17.224491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8300): Terminating (SIGTERM) 10:27:17.268280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8303): Terminating (SIGTERM) 10:27:17.313636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8306): Terminating (SIGTERM) 10:27:17.355685 --- ParallelTerminationStrategy: PID 8296 died... 10:27:17.376169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8296): Terminated: ok {rc=0} 10:27:17.422351 --- ParallelTerminationStrategy: PID 8297 died... 10:27:17.442235 run iperf3-srv_10.42.42.10(pid=8297): Terminated {rc=256} 10:27:17.487409 --- ParallelTerminationStrategy: PID 8300 died... 10:27:17.507143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8300): Terminated: ok {rc=0} 10:27:17.552785 --- ParallelTerminationStrategy: PID 8303 died... 10:27:17.572677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8303): Terminated: ok {rc=0} 10:27:17.617822 --- ParallelTerminationStrategy: PID 8306 died... 10:27:17.637455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8306): Terminated: ok {rc=0} 10:27:17.726141 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:27:18.874187 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:18.885960 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:27:18.957465 tst iperf3m4.py: using LAC 40290 10:27:19.077659 tst iperf3m4.py: using RAC 255 10:27:19.196065 tst iperf3m4.py: using CellId 40290 10:27:19.315430 tst iperf3m4.py: using BVCI 40291 10:27:19.427950 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:19.439189 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:19.450150 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:19.461038 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:19.472588 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:19.484187 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:19.495968 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:19.507516 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:19.519216 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:27:19.642692 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:27:19.765505 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:27:19.884507 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:27:20.006705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:27:20.226438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:27:20.553694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8308): Launched 10:27:20.841166 run iperf3-srv_10.42.42.10(pid=8309): Launched 10:27:20.963157 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:27:21.182292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:27:21.508462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8310): Launched 10:27:21.792866 run iperf3-srv_10.42.42.10(pid=8311): Launched 10:27:21.915391 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:27:22.134421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:27:22.462311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8312): Launched 10:27:22.748577 run iperf3-srv_10.42.42.10(pid=8313): Launched 10:27:22.870746 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:27:23.089459 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:27:23.415758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8314): Launched 10:27:23.701498 run iperf3-srv_10.42.42.10(pid=8315): Launched 10:27:23.824880 tst iperf3m4.py:8: start network... 10:27:24.043772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:24.549147 run create_hlr_db(pid=8316): Launched 10:27:24.683796 bus /gobi_6: Setting Powered False 10:27:25.748094 run create_hlr_db(pid=8316): Terminated: ok {rc=0} 10:27:26.185134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8318): Launched 10:27:26.491556 run osmo-hlr_10.42.42.2(pid=8319): Launched 10:27:26.608913 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:27.148921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8321): Launched 10:27:27.455485 run osmo-stp_10.42.42.5(pid=8322): Launched 10:27:27.571933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:27:28.098582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8324): Launched 10:27:28.216253 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:27:28.475355 run patchelf(pid=8325): Launched 10:27:28.647213 run osmo-stp_10.42.42.5(pid=8322): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8322)] 10:27:28.777069 run osmo-stp_10.42.42.5(pid=8322): stdout: | (launched: 2022-12-14_10:27:27.399166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:28.908532 run osmo-stp_10.42.42.5(pid=8322): stderr: | 20221214102727567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102727567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102727567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102727568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102727568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102727568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102727568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:29.039878 run osmo-stp_10.42.42.5(pid=8322): stdout: | (launched: 2022-12-14_10:27:27.399166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:29.165417 run osmo-stp_10.42.42.5(pid=8322): stderr: | 20221214102727567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102727567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102727567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102727568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102727568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102727568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102727568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:29.314264 run patchelf(pid=8325): Terminating (SIGINT) 10:27:29.486577 run patchelf(pid=8325): Terminated: ok {rc=0} 10:27:29.610660 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8322): Process ended prematurely: osmo-stp_10.42.42.5(pid=8322) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8322)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:27:29.620708 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:27:29.648870 run osmo-hlr_10.42.42.2(pid=8319): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8319)] 10:27:29.697522 run osmo-hlr_10.42.42.2(pid=8319): stdout: | (launched: 2022-12-14_10:27:26.434755) 10:27:29.748004 run osmo-hlr_10.42.42.2(pid=8319): stderr: | 20221214102726608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102726608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102726608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102726608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102726608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102726608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102726623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102726633 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102726633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102726633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:29.798436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8308): Terminating (SIGTERM) 10:27:29.838736 run iperf3-srv_10.42.42.10(pid=8309): Terminating (SIGTERM) 10:27:29.879063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8310): Terminating (SIGTERM) 10:27:29.919421 run iperf3-srv_10.42.42.10(pid=8311): Terminating (SIGTERM) 10:27:29.959477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8312): Terminating (SIGTERM) 10:27:29.999682 run iperf3-srv_10.42.42.10(pid=8313): Terminating (SIGTERM) 10:27:30.041235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8314): Terminating (SIGTERM) 10:27:30.082348 run iperf3-srv_10.42.42.10(pid=8315): Terminating (SIGTERM) 10:27:30.122482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8318): Terminating (SIGTERM) 10:27:30.162682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8321): Terminating (SIGTERM) 10:27:30.202862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8324): Terminating (SIGTERM) 10:27:30.243185 --- ParallelTerminationStrategy: PID 8308 died... 10:27:30.262727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8308): Terminated: ok {rc=0} 10:27:30.307209 --- ParallelTerminationStrategy: PID 8309 died... 10:27:30.326230 run iperf3-srv_10.42.42.10(pid=8309): Terminated {rc=256} 10:27:30.370107 --- ParallelTerminationStrategy: PID 8310 died... 10:27:30.389147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8310): Terminated: ok {rc=0} 10:27:30.433239 --- ParallelTerminationStrategy: PID 8311 died... 10:27:30.451925 run iperf3-srv_10.42.42.10(pid=8311): Terminated {rc=256} 10:27:30.496290 --- ParallelTerminationStrategy: PID 8312 died... 10:27:30.515219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8312): Terminated: ok {rc=0} 10:27:30.559347 --- ParallelTerminationStrategy: PID 8313 died... 10:27:30.578250 run iperf3-srv_10.42.42.10(pid=8313): Terminated {rc=256} 10:27:30.622016 --- ParallelTerminationStrategy: PID 8314 died... 10:27:30.641014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8314): Terminated: ok {rc=0} 10:27:30.685128 --- ParallelTerminationStrategy: PID 8315 died... 10:27:30.704016 run iperf3-srv_10.42.42.10(pid=8315): Terminated {rc=256} 10:27:30.748025 --- ParallelTerminationStrategy: PID 8318 died... 10:27:30.767033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8318): Terminated: ok {rc=0} 10:27:30.811051 --- ParallelTerminationStrategy: PID 8321 died... 10:27:30.830277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8321): Terminated: ok {rc=0} 10:27:30.880522 --- ParallelTerminationStrategy: PID 8324 died... 10:27:30.904784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8324): Terminated: ok {rc=0} 10:27:30.990450 bus /gobi_4: Setting Powered False 10:27:32.103600 bus /gobi_4: Setting Powered False 10:27:33.229610 bus /gobi_1: Setting Powered False 10:27:34.329079 bus /gobi_1: Setting Powered False 10:27:35.447851 bus /gobi_0: Setting Powered False 10:27:36.548743 bus /gobi_0: Setting Powered False 10:27:37.668751 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:27:38.773740 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:38.786062 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:27:38.859905 tst ping.py: using LAC 40291 10:27:38.986568 tst ping.py: using RAC 1 10:27:39.113207 tst ping.py: using CellId 40291 10:27:39.237463 tst ping.py: using BVCI 40292 10:27:39.352610 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:39.364194 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:39.375866 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:39.387257 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:39.398821 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:39.410391 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:39.422049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:39.433516 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:27:39.549916 tst ping.py:19: start network... 10:27:39.764106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:40.256377 run create_hlr_db(pid=8326): Launched 10:27:40.376138 bus /gobi_6: Setting Powered False 10:27:41.436574 run create_hlr_db(pid=8326): Terminated: ok {rc=0} 10:27:41.876079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8328): Launched 10:27:42.197538 run osmo-hlr_10.42.42.2(pid=8329): Launched 10:27:42.320912 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:42.883831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8331): Launched 10:27:43.203747 run osmo-stp_10.42.42.5(pid=8332): Launched 10:27:43.326768 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:27:43.877331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8334): Launched 10:27:43.999405 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:27:44.267989 run patchelf(pid=8335): Launched 10:27:44.448403 run osmo-stp_10.42.42.5(pid=8332): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8332)] 10:27:44.583906 run osmo-stp_10.42.42.5(pid=8332): stdout: | (launched: 2022-12-14_10:27:43.144682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:44.722722 run osmo-stp_10.42.42.5(pid=8332): stderr: | 20221214102743336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102743337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102743337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102743337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102743338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102743338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102743338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:44.859938 run osmo-stp_10.42.42.5(pid=8332): stdout: | (launched: 2022-12-14_10:27:43.144682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:44.990592 run osmo-stp_10.42.42.5(pid=8332): stderr: | 20221214102743336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102743337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102743337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102743337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102743338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102743338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102743338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:45.145308 run patchelf(pid=8335): Terminating (SIGINT) 10:27:45.324768 run patchelf(pid=8335): Terminated: ok {rc=0} 10:27:45.454247 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8332): Process ended prematurely: osmo-stp_10.42.42.5(pid=8332) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8332)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 10:27:45.464453 tst ping.py:22: Test FAILED (6.7 sec) 10:27:45.493335 run osmo-hlr_10.42.42.2(pid=8329): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8329)] 10:27:45.543531 run osmo-hlr_10.42.42.2(pid=8329): stdout: | (launched: 2022-12-14_10:27:42.138595) 10:27:45.595671 run osmo-hlr_10.42.42.2(pid=8329): stderr: | 20221214102742334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102742334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102742334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102742334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102742334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102742334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102742347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102742357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102742357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102742357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:45.648636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8328): Terminating (SIGTERM) 10:27:45.691006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8331): Terminating (SIGTERM) 10:27:45.733131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8334): Terminating (SIGTERM) 10:27:45.775330 --- ParallelTerminationStrategy: PID 8328 died... 10:27:45.795605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8328): Terminated: ok {rc=0} 10:27:45.852453 --- ParallelTerminationStrategy: PID 8331 died... 10:27:45.877111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8331): Terminated: ok {rc=0} 10:27:45.936232 --- ParallelTerminationStrategy: PID 8334 died... 10:27:45.956079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8334): Terminated: ok {rc=0} 10:27:46.049273 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:27:47.143365 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:47.160615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:27:47.246883 tst ping_idle_ping.py: using LAC 40292 10:27:47.383922 tst ping_idle_ping.py: using RAC 2 10:27:47.509649 tst ping_idle_ping.py: using CellId 40292 10:27:47.634778 tst ping_idle_ping.py: using BVCI 40293 10:27:47.751169 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:47.762959 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:47.774470 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:47.786037 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:47.797480 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:47.808903 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:47.820474 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:27:47.831815 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:27:47.951385 tst ping_idle_ping.py:24: start network... 10:27:48.167517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:48.667235 run create_hlr_db(pid=8336): Launched 10:27:48.799542 bus /gobi_6: Setting Powered False 10:27:49.863059 run create_hlr_db(pid=8336): Terminated: ok {rc=0} 10:27:50.294449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8338): Launched 10:27:50.596334 run osmo-hlr_10.42.42.2(pid=8339): Launched 10:27:50.712326 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:51.247317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8341): Launched 10:27:51.549315 run osmo-stp_10.42.42.5(pid=8342): Launched 10:27:51.665080 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:27:52.194514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8344): Launched 10:27:52.310518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:27:52.565323 run patchelf(pid=8345): Launched 10:27:52.734271 run osmo-stp_10.42.42.5(pid=8342): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8342)] 10:27:52.862074 run osmo-stp_10.42.42.5(pid=8342): stdout: | (launched: 2022-12-14_10:27:51.493763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:52.992117 run osmo-stp_10.42.42.5(pid=8342): stderr: | 20221214102751667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102751667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102751667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102751668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102751668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102751668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102751668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:53.122532 run osmo-stp_10.42.42.5(pid=8342): stdout: | (launched: 2022-12-14_10:27:51.493763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:53.246480 run osmo-stp_10.42.42.5(pid=8342): stderr: | 20221214102751667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102751667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102751667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102751668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102751668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102751668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102751668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:53.393363 run patchelf(pid=8345): Terminating (SIGINT) 10:27:53.563952 run patchelf(pid=8345): Terminated: ok {rc=0} 10:27:53.687439 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8342): Process ended prematurely: osmo-stp_10.42.42.5(pid=8342) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8342)] [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:27:53.696604 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:27:53.723307 run osmo-hlr_10.42.42.2(pid=8339): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8339)] 10:27:53.771811 run osmo-hlr_10.42.42.2(pid=8339): stdout: | (launched: 2022-12-14_10:27:50.540623) 10:27:53.821458 run osmo-hlr_10.42.42.2(pid=8339): stderr: | 20221214102750718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102750718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102750719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102750719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102750719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102750719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102750732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102750742 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102750742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102750742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:53.871731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8338): Terminating (SIGTERM) 10:27:53.911933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8341): Terminating (SIGTERM) 10:27:53.951894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8344): Terminating (SIGTERM) 10:27:53.992405 --- ParallelTerminationStrategy: PID 8338 died... 10:27:54.012102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8338): Terminated: ok {rc=0} 10:27:54.056094 --- ParallelTerminationStrategy: PID 8341 died... 10:27:54.074992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8341): Terminated: ok {rc=0} 10:27:54.118973 --- ParallelTerminationStrategy: PID 8344 died... 10:27:54.137867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8344): Terminated: ok {rc=0} 10:27:54.224011 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:27:55.531507 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:27:55.538267 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:27:55.571803 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:27:55.609757 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:27:55.665353 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:27:55.700319 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:27:55.735732 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:27:56.290793 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:27:56.297071 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:27:56.308861 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:27:56.379888 tst switch_tch_pdch.py: using LAC 40293 10:27:56.498620 tst switch_tch_pdch.py: using RAC 3 10:27:56.617392 tst switch_tch_pdch.py: using CellId 40293 10:27:56.734904 tst switch_tch_pdch.py: using BVCI 40294 10:27:56.844560 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:27:56.855882 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:27:56.867011 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:27:56.878213 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:27:56.889642 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:27:56.900925 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:27:56.912488 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:27:56.923969 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:27:57.044920 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:27:57.164537 tst switch_tch_pdch.py:51: start network... 10:27:57.379706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:57.874641 run create_hlr_db(pid=8349): Launched 10:27:58.007817 bus /gobi_6: Setting Powered False 10:27:59.067450 run create_hlr_db(pid=8349): Terminated: ok {rc=0} 10:27:59.497197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8351): Launched 10:27:59.799030 run osmo-hlr_10.42.42.2(pid=8352): Launched 10:27:59.913300 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:00.444856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8354): Launched 10:28:00.744283 run osmo-stp_10.42.42.5(pid=8355): Launched 10:28:00.920897 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:28:01.522142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8357): Launched 10:28:01.694986 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:28:01.996884 run patchelf(pid=8358): Launched 10:28:02.182644 run osmo-stp_10.42.42.5(pid=8355): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8355)] 10:28:02.313862 run osmo-stp_10.42.42.5(pid=8355): stdout: | (launched: 2022-12-14_10:28:00.688738) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:02.443666 run osmo-stp_10.42.42.5(pid=8355): stderr: | 20221214102800877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102800877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102800877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102800877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102800878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102800878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102800878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:02.573535 run osmo-stp_10.42.42.5(pid=8355): stdout: | (launched: 2022-12-14_10:28:00.688738) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:02.696577 run osmo-stp_10.42.42.5(pid=8355): stderr: | 20221214102800877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102800877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102800877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102800877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102800878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102800878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102800878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:02.842964 run patchelf(pid=8358): Terminating (SIGINT) 10:28:03.011655 run patchelf(pid=8358): Terminated: ok {rc=0} 10:28:03.133675 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8355): Process ended prematurely: osmo-stp_10.42.42.5(pid=8355) [trial-2403↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8355)] [trial-2403↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:28:03.142774 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 10:28:03.169832 run osmo-hlr_10.42.42.2(pid=8352): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8352)] 10:28:03.218590 run osmo-hlr_10.42.42.2(pid=8352): stdout: | (launched: 2022-12-14_10:27:59.743422) 10:28:03.269095 run osmo-hlr_10.42.42.2(pid=8352): stderr: | 20221214102759919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102759919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102759919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102759919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102759919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102759919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102759936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102759946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102759946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102759946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:03.319665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8351): Terminating (SIGTERM) 10:28:03.360220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8354): Terminating (SIGTERM) 10:28:03.400802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8357): Terminating (SIGTERM) 10:28:03.441586 --- ParallelTerminationStrategy: PID 8351 died... 10:28:03.461527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8351): Terminated: ok {rc=0} 10:28:03.506465 --- ParallelTerminationStrategy: PID 8354 died... 10:28:03.525777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8354): Terminated: ok {rc=0} 10:28:03.570349 --- ParallelTerminationStrategy: PID 8357 died... 10:28:03.589768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8357): Terminated: ok {rc=0} 10:28:03.677740 bus /gobi_0: Setting Powered False 10:28:04.777222 bus /gobi_0: Setting Powered False 10:28:05.893226 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:28:07.146364 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:28:07.152271 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:28:07.185471 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:28:07.220801 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:28:07.273939 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:28:07.307257 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:28:07.341625 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:28:07.897111 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:28:07.902409 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:28:07.913611 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:28:07.982826 tst switch_tch_pdch.py: using LAC 40294 10:28:08.102829 tst switch_tch_pdch.py: using RAC 4 10:28:08.221362 tst switch_tch_pdch.py: using CellId 40294 10:28:08.339008 tst switch_tch_pdch.py: using BVCI 40295 10:28:08.449587 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:28:08.460570 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:28:08.471480 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:28:08.482396 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:28:08.493534 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:28:08.504709 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:28:08.515974 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:28:08.527199 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:28:08.647639 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:28:08.766847 tst switch_tch_pdch.py:51: start network... 10:28:08.969370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:09.408248 run create_hlr_db(pid=8363): Launched 10:28:09.525416 bus /gobi_6: Setting Powered False 10:28:10.585868 run create_hlr_db(pid=8363): Terminated: ok {rc=0} 10:28:10.999326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8365): Launched 10:28:11.320340 run osmo-hlr_10.42.42.2(pid=8366): Launched 10:28:11.443031 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:11.966588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8368): Launched 10:28:12.285914 run osmo-stp_10.42.42.5(pid=8369): Launched 10:28:12.409788 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:28:12.934293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8371): Launched 10:28:13.057848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:28:13.327862 run patchelf(pid=8372): Launched 10:28:13.507420 run osmo-stp_10.42.42.5(pid=8369): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8369)] 10:28:13.642789 run osmo-stp_10.42.42.5(pid=8369): stdout: | (launched: 2022-12-14_10:28:12.227337) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:13.780561 run osmo-stp_10.42.42.5(pid=8369): stderr: | 20221214102812418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102812418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102812418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102812419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102812419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102812419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102812419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:13.917717 run osmo-stp_10.42.42.5(pid=8369): stdout: | (launched: 2022-12-14_10:28:12.227337) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:14.048308 run osmo-stp_10.42.42.5(pid=8369): stderr: | 20221214102812418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102812418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102812418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102812419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102812419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102812419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102812419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:14.203468 run patchelf(pid=8372): Terminating (SIGINT) 10:28:14.382674 run patchelf(pid=8372): Terminated: ok {rc=0} 10:28:14.512286 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8369): Process ended prematurely: osmo-stp_10.42.42.5(pid=8369) [trial-2403↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8369)] [trial-2403↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:28:14.522086 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 10:28:14.550300 run osmo-hlr_10.42.42.2(pid=8366): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8366)] 10:28:14.600500 run osmo-hlr_10.42.42.2(pid=8366): stdout: | (launched: 2022-12-14_10:28:11.261615) 10:28:14.653203 run osmo-hlr_10.42.42.2(pid=8366): stderr: | 20221214102811460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102811460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102811460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102811460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102811460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102811460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102811519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102811529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102811529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102811529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:14.705755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8365): Terminating (SIGTERM) 10:28:14.748215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8368): Terminating (SIGTERM) 10:28:14.790270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8371): Terminating (SIGTERM) 10:28:14.833402 --- ParallelTerminationStrategy: PID 8365 died... 10:28:14.853622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8365): Terminated: ok {rc=0} 10:28:14.898943 --- ParallelTerminationStrategy: PID 8368 died... 10:28:14.918702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8368): Terminated: ok {rc=0} 10:28:14.963709 --- ParallelTerminationStrategy: PID 8371 died... 10:28:14.983616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8371): Terminated: ok {rc=0} 10:28:15.071731 bus /gobi_0: Setting Powered False 10:28:16.179276 bus /gobi_0: Setting Powered False 10:28:17.313827 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_sms:trx-umtrx --------------------------------------------------------------------- 10:28:18.571066 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:28:18.574991 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:28:18.606775 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 10:28:18.614535 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 10:28:18.667410 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:28:18.701149 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 10:28:18.708549 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 10:28:19.244755 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 10:28:19.250347 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 10:28:19.261820 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 10:28:19.311600 tst mo_mt_sms.py: using LAC 40295 10:28:19.436653 tst mo_mt_sms.py: using RAC 5 10:28:19.561376 tst mo_mt_sms.py: using CellId 40295 10:28:19.686344 tst mo_mt_sms.py: using BVCI 40296 10:28:19.803055 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:28:19.923556 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:28:20.037879 tst mo_mt_sms.py:9: start nitb and bts... 10:28:20.258620 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:28:20.912083 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8377): Launched 10:28:21.234359 run osmo-nitb_10.42.42.2(pid=8378): Launched 10:28:21.413574 run osmo-nitb_10.42.42.2(pid=8378): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8378)] 10:28:21.557460 run osmo-nitb_10.42.42.2(pid=8378): stdout: | (launched: 2022-12-14_10:28:21.175498) 10:28:21.703274 run osmo-nitb_10.42.42.2(pid=8378): stderr: | (launched: 2022-12-14_10:28:21.222916) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:28:21.848273 run osmo-nitb_10.42.42.2(pid=8378): stdout: | (launched: 2022-12-14_10:28:21.175498) 10:28:21.987718 run osmo-nitb_10.42.42.2(pid=8378): stderr: | (launched: 2022-12-14_10:28:21.222916) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8378): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8378) [trial-2403↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8378)] 10:28:22.357591 tst osmo-nitb_10.42.42.2(pid=8378): stdout: | (launched: 2022-12-14_10:28:21.175498) 10:28:22.486060 tst osmo-nitb_10.42.42.2(pid=8378): stderr: | (launched: 2022-12-14_10:28:21.222916) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:28:22.638061 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=8378): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8378) [trial-2403↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8378)] [trial-2403↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 10:28:22.647130 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 10:28:22.654608 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8377): Terminating (SIGTERM) 10:28:22.865627 --- ParallelTerminationStrategy: PID 8377 died... 10:28:22.887721 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8377): Terminated: ok {rc=0} 10:28:22.977256 bus /sierra_3: Setting Powered False 10:28:24.077700 bus /sierra_3: Setting Powered False 10:28:25.196872 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 sms:trx-umtrx --------------------------------------------------------------------- 10:28:26.400456 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:28:26.405123 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:28:26.438154 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 10:28:26.465652 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 10:28:26.518066 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:28:26.550504 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 10:28:26.577493 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 10:28:27.121682 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 10:28:27.126878 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:28:27.137550 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 10:28:27.184012 tst mo_mt_sms.py: using LAC 40296 10:28:27.303510 tst mo_mt_sms.py: using RAC 6 10:28:27.420003 tst mo_mt_sms.py: using CellId 40296 10:28:27.544657 tst mo_mt_sms.py: using BVCI 40297 10:28:27.655757 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:28:27.666612 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:28:27.677567 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:28:27.687967 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:28:27.698907 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:28:27.709568 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:28:27.830360 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:28:27.949245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:28.441554 run create_hlr_db(pid=8382): Launched 10:28:28.571226 bus /sierra_2: Setting Powered False 10:28:29.635567 run create_hlr_db(pid=8382): Terminated: ok {rc=0} 10:28:30.064516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8384): Launched 10:28:30.364337 run osmo-hlr_10.42.42.2(pid=8385): Launched 10:28:30.480859 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:31.026811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8387): Launched 10:28:31.369230 run osmo-stp_10.42.42.5(pid=8388): Launched 10:28:31.607824 run osmo-msc_10.42.42.6: Starting osmo-msc 10:28:32.270405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8390): Launched 10:28:32.589966 run osmo-msc_10.42.42.6(pid=8391): Launched 10:28:32.770561 run osmo-stp_10.42.42.5(pid=8388): ERR: Terminated: ERROR {rc=1} [trial-2403↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8388)] 10:28:32.903504 run osmo-stp_10.42.42.5(pid=8388): stdout: | (launched: 2022-12-14_10:28:31.308407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:33.038578 run osmo-stp_10.42.42.5(pid=8388): stderr: | 20221214102831601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102831601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102831601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102831602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102831602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102831602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102831602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:33.171805 run osmo-stp_10.42.42.5(pid=8388): stdout: | (launched: 2022-12-14_10:28:31.308407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:33.298306 run osmo-stp_10.42.42.5(pid=8388): stderr: | 20221214102831601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102831601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102831601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102831602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102831602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102831602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102831602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:33.449275 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8388): Process ended prematurely: osmo-stp_10.42.42.5(pid=8388) [trial-2403↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8388)] [trial-2403↪sms:trx-umtrx↪mo_mt_sms.py:16] 10:28:33.458591 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 10:28:33.485975 run osmo-hlr_10.42.42.2(pid=8385): ERR: Terminated: ERROR {rc=237} [trial-2403↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8385)] 10:28:33.536078 run osmo-hlr_10.42.42.2(pid=8385): stdout: | (launched: 2022-12-14_10:28:30.309037) 10:28:33.588073 run osmo-hlr_10.42.42.2(pid=8385): stderr: | 20221214102830485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102830485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102830486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102830486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102830486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102830486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102830498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102830506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102830506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102830506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:33.660759 run osmo-msc_10.42.42.6(pid=8391): ERR: Terminated: ERROR {rc=2} [trial-2403↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8391)] 10:28:33.710757 run osmo-msc_10.42.42.6(pid=8391): stdout: | (launched: 2022-12-14_10:28:32.531222) 10:28:33.763115 run osmo-msc_10.42.42.6(pid=8391): stderr: | 20221214102832852 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102832852 DLGLOBAL DEBUG validating counter group 0x7f14120bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102832852 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102832852 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102832853 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102832853 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102832855 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102832855 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102832855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102832855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:28:33.815330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8384): Terminating (SIGTERM) 10:28:33.857428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8387): Terminating (SIGTERM) 10:28:33.899878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8390): Terminating (SIGTERM) 10:28:33.942244 --- ParallelTerminationStrategy: PID 8384 died... 10:28:33.962580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8384): Terminated: ok {rc=0} 10:28:34.009054 --- ParallelTerminationStrategy: PID 8387 died... 10:28:34.028574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8387): Terminated: ok {rc=0} 10:28:34.074646 --- ParallelTerminationStrategy: PID 8390 died... 10:28:34.094472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8390): Terminated: ok {rc=0} 10:28:34.182515 bus /sierra_3: Setting Powered False 10:28:35.278480 bus /sierra_3: Setting Powered False 10:28:36.394616 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 10:28:37.631191 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:28:37.635984 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:28:37.670024 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 10:28:37.678015 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 10:28:37.714003 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:28:37.746272 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 10:28:37.752900 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 10:28:38.271320 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2403 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 10:28:38.276180 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 10:28:38.286869 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 10:28:38.334931 tst assert_extension.py: using LAC 40297 10:28:38.459762 tst assert_extension.py: using RAC 7 10:28:38.583614 tst assert_extension.py: using CellId 40297 10:28:38.703469 tst assert_extension.py: using BVCI 40298 10:28:38.821533 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 10:28:38.938264 tst assert_extension.py:10: start nitb and bts... 10:28:39.138846 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:28:39.749273 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8396): Launched 10:28:40.048267 run osmo-nitb_10.42.42.2(pid=8397): Launched 10:28:40.214042 run osmo-nitb_10.42.42.2(pid=8397): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8397)] 10:28:40.348219 run osmo-nitb_10.42.42.2(pid=8397): stdout: | (launched: 2022-12-14_10:28:39.993202) 10:28:40.484660 run osmo-nitb_10.42.42.2(pid=8397): stderr: | (launched: 2022-12-14_10:28:40.037367) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:28:40.620769 run osmo-nitb_10.42.42.2(pid=8397): stdout: | (launched: 2022-12-14_10:28:39.993202) 10:28:40.750949 run osmo-nitb_10.42.42.2(pid=8397): stderr: | (launched: 2022-12-14_10:28:40.037367) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8397): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8397) [trial-2403↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8397)] 10:28:41.161667 tst osmo-nitb_10.42.42.2(pid=8397): stdout: | (launched: 2022-12-14_10:28:39.993202) 10:28:41.281880 tst osmo-nitb_10.42.42.2(pid=8397): stderr: | (launched: 2022-12-14_10:28:40.037367) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:28:41.424429 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8397): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8397) [trial-2403↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8397)] [trial-2403↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 10:28:41.433244 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:28:41.440056 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8396): Terminating (SIGTERM) 10:28:41.649544 --- ParallelTerminationStrategy: PID 8396 died... 10:28:41.671078 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8396): Terminated: ok {rc=0} 10:28:41.757842 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 ussd:trx-umtrx --------------------------------------------------------------------- 10:28:42.940329 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:28:42.944758 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:28:42.978010 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 10:28:43.005888 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 10:28:43.042753 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:28:43.076847 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 10:28:43.104776 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 10:28:43.631884 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2403 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 10:28:43.637465 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:28:43.648481 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 10:28:43.697123 tst assert_extension.py: using LAC 40298 10:28:43.814224 tst assert_extension.py: using RAC 8 10:28:43.933060 tst assert_extension.py: using CellId 40298 10:28:44.059049 tst assert_extension.py: using BVCI 40299 10:28:44.176508 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:28:44.187784 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:28:44.199224 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:28:44.210334 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:28:44.221718 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:28:44.232673 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 10:28:44.349509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:44.813748 run create_hlr_db(pid=8401): Launched 10:28:44.928514 bus /sierra_2: Setting Powered False 10:28:45.995159 run create_hlr_db(pid=8401): Terminated: ok {rc=0} 10:28:46.423679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8403): Launched 10:28:46.764624 run osmo-hlr_10.42.42.2(pid=8404): Launched 10:28:47.016244 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:47.598553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8406): Launched 10:28:47.919869 run osmo-stp_10.42.42.5(pid=8407): Launched 10:28:48.041721 run osmo-msc_10.42.42.6: Starting osmo-msc 10:28:48.617061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8409): Launched 10:28:48.934588 run osmo-msc_10.42.42.6(pid=8410): Launched 10:28:49.111421 run osmo-stp_10.42.42.5(pid=8407): ERR: Terminated: ERROR {rc=1} [trial-2403↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8407)] 10:28:49.245469 run osmo-stp_10.42.42.5(pid=8407): stdout: | (launched: 2022-12-14_10:28:47.861355) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:49.379914 run osmo-stp_10.42.42.5(pid=8407): stderr: | 20221214102848054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102848054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102848054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102848055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102848055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102848055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102848055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:49.513161 run osmo-stp_10.42.42.5(pid=8407): stdout: | (launched: 2022-12-14_10:28:47.861355) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:49.639784 run osmo-stp_10.42.42.5(pid=8407): stderr: | 20221214102848054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102848054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102848054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102848055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102848055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102848055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102848055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:49.791431 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8407): Process ended prematurely: osmo-stp_10.42.42.5(pid=8407) [trial-2403↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8407)] [trial-2403↪ussd:trx-umtrx↪assert_extension.py:17] 10:28:49.800682 tst assert_extension.py:17: Test FAILED (6.2 sec) 10:28:49.828374 run osmo-hlr_10.42.42.2(pid=8404): ERR: Terminated: ERROR {rc=237} [trial-2403↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8404)] 10:28:49.878499 run osmo-hlr_10.42.42.2(pid=8404): stdout: | (launched: 2022-12-14_10:28:46.705040) 10:28:49.930341 run osmo-hlr_10.42.42.2(pid=8404): stderr: | 20221214102846987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102846987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102846987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102846987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102846987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102846987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102846998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102847017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102847017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102847017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:50.002494 run osmo-msc_10.42.42.6(pid=8410): ERR: Terminated: ERROR {rc=2} [trial-2403↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8410)] 10:28:50.052354 run osmo-msc_10.42.42.6(pid=8410): stdout: | (launched: 2022-12-14_10:28:48.876028) 10:28:50.103928 run osmo-msc_10.42.42.6(pid=8410): stderr: | 20221214102849196 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102849196 DLGLOBAL DEBUG validating counter group 0x7f668b9c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102849197 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102849197 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102849197 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102849197 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102849199 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102849199 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102849199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102849199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:28:50.156358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8403): Terminating (SIGTERM) 10:28:50.198281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8406): Terminating (SIGTERM) 10:28:50.240126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8409): Terminating (SIGTERM) 10:28:50.282364 --- ParallelTerminationStrategy: PID 8403 died... 10:28:50.302571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8403): Terminated: ok {rc=0} 10:28:50.348896 --- ParallelTerminationStrategy: PID 8406 died... 10:28:50.368585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8406): Terminated: ok {rc=0} 10:28:50.414665 --- ParallelTerminationStrategy: PID 8409 died... 10:28:50.434469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8409): Terminated: ok {rc=0} 10:28:50.522940 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:28:51.730547 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:28:51.737293 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:28:51.769395 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:28:51.797202 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:28:51.849244 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:28:51.882039 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:28:51.909145 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:28:52.462456 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:28:52.515557 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:28:52.527230 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:28:52.597475 tst mo_mt_call.py: using LAC 40299 10:28:52.718271 tst mo_mt_call.py: using RAC 9 10:28:52.838313 tst mo_mt_call.py: using CellId 40299 10:28:52.958493 tst mo_mt_call.py: using BVCI 40300 10:28:53.070728 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:28:53.081999 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:28:53.092898 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:28:53.103807 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:28:53.115094 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:28:53.126826 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:28:53.247001 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:28:53.364201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:53.835849 run create_hlr_db(pid=8415): Launched 10:28:53.952103 bus /sierra_2: Setting Powered False 10:28:55.012879 run create_hlr_db(pid=8415): Terminated: ok {rc=0} 10:28:55.459897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8417): Launched 10:28:55.789088 run osmo-hlr_10.42.42.2(pid=8418): Launched 10:28:55.914770 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:56.475275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8420): Launched 10:28:56.802904 run osmo-stp_10.42.42.5(pid=8421): Launched 10:28:56.927884 run osmo-msc_10.42.42.6: Starting osmo-msc 10:28:57.516628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8423): Launched 10:28:57.845665 run osmo-msc_10.42.42.6(pid=8424): Launched 10:28:58.027873 run osmo-stp_10.42.42.5(pid=8421): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8421)] 10:28:58.164345 run osmo-stp_10.42.42.5(pid=8421): stdout: | (launched: 2022-12-14_10:28:56.743270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:58.301629 run osmo-stp_10.42.42.5(pid=8421): stderr: | 20221214102856936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102856936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102856936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102856936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102856937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102856937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102856937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:58.438455 run osmo-stp_10.42.42.5(pid=8421): stdout: | (launched: 2022-12-14_10:28:56.743270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:58.567925 run osmo-stp_10.42.42.5(pid=8421): stderr: | 20221214102856936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102856936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102856936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102856936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102856937 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102856937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102856937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:58.723774 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8421): Process ended prematurely: osmo-stp_10.42.42.5(pid=8421) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8421)] [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:28:58.733828 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:28:58.762079 run osmo-hlr_10.42.42.2(pid=8418): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8418)] 10:28:58.812872 run osmo-hlr_10.42.42.2(pid=8418): stdout: | (launched: 2022-12-14_10:28:55.729599) 10:28:58.865444 run osmo-hlr_10.42.42.2(pid=8418): stderr: | 20221214102855928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102855928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102855928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102855928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102855928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102855928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102855940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102855948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102855949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102855949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:58.938800 run osmo-msc_10.42.42.6(pid=8424): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8424)] 10:28:58.989357 run osmo-msc_10.42.42.6(pid=8424): stdout: | (launched: 2022-12-14_10:28:57.785740) 10:28:59.041455 run osmo-msc_10.42.42.6(pid=8424): stderr: | 20221214102858108 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102858109 DLGLOBAL DEBUG validating counter group 0x7f354aed5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102858109 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102858109 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102858109 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102858109 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102858111 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102858111 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102858111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102858111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:28:59.094077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8417): Terminating (SIGTERM) 10:28:59.136637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8420): Terminating (SIGTERM) 10:28:59.179425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8423): Terminating (SIGTERM) 10:28:59.222378 --- ParallelTerminationStrategy: PID 8417 died... 10:28:59.242923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8417): Terminated: ok {rc=0} 10:28:59.289869 --- ParallelTerminationStrategy: PID 8420 died... 10:28:59.310012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8420): Terminated: ok {rc=0} 10:28:59.356824 --- ParallelTerminationStrategy: PID 8423 died... 10:28:59.377329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8423): Terminated: ok {rc=0} 10:28:59.466951 bus /sierra_3: Setting Powered False 10:29:00.567820 bus /sierra_3: Setting Powered False 10:29:01.707858 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:29:02.860907 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:29:02.872689 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:29:02.941834 tst mo_mt_call_osmux.py: using LAC 40300 10:29:03.061860 tst mo_mt_call_osmux.py: using RAC 10 10:29:03.184933 tst mo_mt_call_osmux.py: using CellId 40300 10:29:03.303196 tst mo_mt_call_osmux.py: using BVCI 40301 10:29:03.414533 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:29:03.425669 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:29:03.436635 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:29:03.447519 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:29:03.458892 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:29:03.470123 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:29:03.587380 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:29:03.704594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:04.176269 run create_hlr_db(pid=8426): Launched 10:29:04.292169 bus /sierra_2: Setting Powered False 10:29:05.353462 run create_hlr_db(pid=8426): Terminated: ok {rc=0} 10:29:05.798688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8428): Launched 10:29:06.126091 run osmo-hlr_10.42.42.2(pid=8429): Launched 10:29:06.251780 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:06.815779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8431): Launched 10:29:07.143516 run osmo-stp_10.42.42.5(pid=8432): Launched 10:29:07.267636 run osmo-msc_10.42.42.6: Starting osmo-msc 10:29:07.861329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8434): Launched 10:29:08.188722 run osmo-msc_10.42.42.6(pid=8435): Launched 10:29:08.371457 run osmo-stp_10.42.42.5(pid=8432): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8432)] 10:29:08.507783 run osmo-stp_10.42.42.5(pid=8432): stdout: | (launched: 2022-12-14_10:29:07.083682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:08.645225 run osmo-stp_10.42.42.5(pid=8432): stderr: | 20221214102907277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102907277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102907277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102907277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102907278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102907278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102907278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:08.782077 run osmo-stp_10.42.42.5(pid=8432): stdout: | (launched: 2022-12-14_10:29:07.083682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:08.910913 run osmo-stp_10.42.42.5(pid=8432): stderr: | 20221214102907277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102907277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102907277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102907277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102907278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102907278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102907278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:09.065397 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8432): Process ended prematurely: osmo-stp_10.42.42.5(pid=8432) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8432)] [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:29:09.075216 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:29:09.103557 run osmo-hlr_10.42.42.2(pid=8429): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8429)] 10:29:09.154561 run osmo-hlr_10.42.42.2(pid=8429): stdout: | (launched: 2022-12-14_10:29:06.066498) 10:29:09.207563 run osmo-hlr_10.42.42.2(pid=8429): stderr: | 20221214102906263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102906263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102906263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102906263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102906264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102906264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102906278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102906286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102906286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102906286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:09.281621 run osmo-msc_10.42.42.6(pid=8435): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8435)] 10:29:09.332265 run osmo-msc_10.42.42.6(pid=8435): stdout: | (launched: 2022-12-14_10:29:08.128792) 10:29:09.385278 run osmo-msc_10.42.42.6(pid=8435): stderr: | 20221214102908453 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102908453 DLGLOBAL DEBUG validating counter group 0x7f0ac41f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102908453 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102908453 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102908453 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102908454 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102908455 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102908456 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102908456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102908456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:29:09.438396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8428): Terminating (SIGTERM) 10:29:09.480858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8431): Terminating (SIGTERM) 10:29:09.523556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8434): Terminating (SIGTERM) 10:29:09.566482 --- ParallelTerminationStrategy: PID 8428 died... 10:29:09.587224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8428): Terminated: ok {rc=0} 10:29:09.634297 --- ParallelTerminationStrategy: PID 8431 died... 10:29:09.654453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8431): Terminated: ok {rc=0} 10:29:09.701754 --- ParallelTerminationStrategy: PID 8434 died... 10:29:09.721769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8434): Terminated: ok {rc=0} 10:29:09.810516 bus /sierra_3: Setting Powered False 10:29:10.909814 bus /sierra_3: Setting Powered False 10:29:12.029971 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:29:13.285367 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:29:13.292762 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:29:13.326109 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:29:13.353455 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:29:13.406921 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:29:13.439964 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:29:13.467103 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:29:14.019082 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:29:14.070668 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:29:14.082273 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:29:14.153151 tst mo_mt_call.py: using LAC 40301 10:29:14.280266 tst mo_mt_call.py: using RAC 11 10:29:14.406818 tst mo_mt_call.py: using CellId 40301 10:29:14.535454 tst mo_mt_call.py: using BVCI 40302 10:29:14.648229 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:29:14.659468 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:29:14.670562 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:29:14.681626 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:29:14.693219 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:29:14.704881 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:29:14.825829 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:29:14.943857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:15.418847 run create_hlr_db(pid=8440): Launched 10:29:15.537913 bus /sierra_2: Setting Powered False 10:29:16.602740 run create_hlr_db(pid=8440): Terminated: ok {rc=0} 10:29:17.063808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8442): Launched 10:29:17.401462 run osmo-hlr_10.42.42.2(pid=8443): Launched 10:29:17.526226 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:18.086825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8445): Launched 10:29:18.413539 run osmo-stp_10.42.42.5(pid=8446): Launched 10:29:18.538917 run osmo-msc_10.42.42.6: Starting osmo-msc 10:29:19.126553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8448): Launched 10:29:19.453064 run osmo-msc_10.42.42.6(pid=8449): Launched 10:29:19.635086 run osmo-stp_10.42.42.5(pid=8446): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8446)] 10:29:19.772022 run osmo-stp_10.42.42.5(pid=8446): stdout: | (launched: 2022-12-14_10:29:18.353879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:19.908650 run osmo-stp_10.42.42.5(pid=8446): stderr: | 20221214102918547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102918547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102918548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102918548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102918549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102918549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102918549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:20.044126 run osmo-stp_10.42.42.5(pid=8446): stdout: | (launched: 2022-12-14_10:29:18.353879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:20.172503 run osmo-stp_10.42.42.5(pid=8446): stderr: | 20221214102918547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102918547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102918548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102918548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102918549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102918549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102918549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:20.326689 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8446): Process ended prematurely: osmo-stp_10.42.42.5(pid=8446) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8446)] [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:29:20.336495 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:29:20.364753 run osmo-hlr_10.42.42.2(pid=8443): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8443)] 10:29:20.415466 run osmo-hlr_10.42.42.2(pid=8443): stdout: | (launched: 2022-12-14_10:29:17.341444) 10:29:20.467974 run osmo-hlr_10.42.42.2(pid=8443): stderr: | 20221214102917542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102917542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102917542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102917542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102917542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102917542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102917555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102917563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102917563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102917563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:20.541375 run osmo-msc_10.42.42.6(pid=8449): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8449)] 10:29:20.592021 run osmo-msc_10.42.42.6(pid=8449): stdout: | (launched: 2022-12-14_10:29:19.393532) 10:29:20.644316 run osmo-msc_10.42.42.6(pid=8449): stderr: | 20221214102919716 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102919716 DLGLOBAL DEBUG validating counter group 0x7fe473b7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102919716 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102919716 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102919717 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102919717 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102919718 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102919719 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102919719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102919719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:29:20.697509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8442): Terminating (SIGTERM) 10:29:20.740041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8445): Terminating (SIGTERM) 10:29:20.782564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8448): Terminating (SIGTERM) 10:29:20.825409 --- ParallelTerminationStrategy: PID 8442 died... 10:29:20.845556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8442): Terminated: ok {rc=0} 10:29:20.891776 --- ParallelTerminationStrategy: PID 8445 died... 10:29:20.911456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8445): Terminated: ok {rc=0} 10:29:20.957814 --- ParallelTerminationStrategy: PID 8448 died... 10:29:20.977582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8448): Terminated: ok {rc=0} 10:29:21.066744 bus /sierra_3: Setting Powered False 10:29:22.166820 bus /sierra_3: Setting Powered False 10:29:23.283452 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:29:24.433445 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:29:24.445870 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:29:24.517125 tst mo_mt_call_osmux.py: using LAC 40302 10:29:24.645008 tst mo_mt_call_osmux.py: using RAC 12 10:29:24.772683 tst mo_mt_call_osmux.py: using CellId 40302 10:29:24.904111 tst mo_mt_call_osmux.py: using BVCI 40303 10:29:25.023215 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:29:25.034880 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:29:25.046337 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:29:25.057702 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:29:25.069169 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:29:25.080542 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:29:25.197753 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:29:25.322830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:25.799113 run create_hlr_db(pid=8451): Launched 10:29:25.919599 bus /sierra_2: Setting Powered False 10:29:26.979890 run create_hlr_db(pid=8451): Terminated: ok {rc=0} 10:29:27.428495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8453): Launched 10:29:27.756311 run osmo-hlr_10.42.42.2(pid=8454): Launched 10:29:27.882071 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:28.444016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8456): Launched 10:29:28.773454 run osmo-stp_10.42.42.5(pid=8457): Launched 10:29:28.897601 run osmo-msc_10.42.42.6: Starting osmo-msc 10:29:29.491803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8459): Launched 10:29:29.820096 run osmo-msc_10.42.42.6(pid=8460): Launched 10:29:30.002930 run osmo-stp_10.42.42.5(pid=8457): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8457)] 10:29:30.139404 run osmo-stp_10.42.42.5(pid=8457): stdout: | (launched: 2022-12-14_10:29:28.712850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:30.276529 run osmo-stp_10.42.42.5(pid=8457): stderr: | 20221214102928906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102928906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102928906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102928907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102928907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102928907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102928907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:30.413182 run osmo-stp_10.42.42.5(pid=8457): stdout: | (launched: 2022-12-14_10:29:28.712850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:30.542201 run osmo-stp_10.42.42.5(pid=8457): stderr: | 20221214102928906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102928906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102928906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102928907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102928907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102928907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102928907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:30.697413 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8457): Process ended prematurely: osmo-stp_10.42.42.5(pid=8457) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8457)] [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:29:30.707139 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:29:30.735334 run osmo-hlr_10.42.42.2(pid=8454): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8454)] 10:29:30.785796 run osmo-hlr_10.42.42.2(pid=8454): stdout: | (launched: 2022-12-14_10:29:27.696252) 10:29:30.838264 run osmo-hlr_10.42.42.2(pid=8454): stderr: | 20221214102927895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102927895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102927895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102927895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102927895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102927896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102927923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102927933 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102927933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102927933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:30.926030 run osmo-msc_10.42.42.6(pid=8460): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8460)] 10:29:30.978133 run osmo-msc_10.42.42.6(pid=8460): stdout: | (launched: 2022-12-14_10:29:29.759533) 10:29:31.031412 run osmo-msc_10.42.42.6(pid=8460): stderr: | 20221214102930081 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102930081 DLGLOBAL DEBUG validating counter group 0x7fd1125a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102930082 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102930082 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102930082 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102930082 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102930084 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102930084 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102930084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102930084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:29:31.084792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8453): Terminating (SIGTERM) 10:29:31.128369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8456): Terminating (SIGTERM) 10:29:31.173120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8459): Terminating (SIGTERM) 10:29:31.216180 --- ParallelTerminationStrategy: PID 8453 died... 10:29:31.236640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8453): Terminated: ok {rc=0} 10:29:31.284035 --- ParallelTerminationStrategy: PID 8456 died... 10:29:31.304301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8456): Terminated: ok {rc=0} 10:29:31.351648 --- ParallelTerminationStrategy: PID 8459 died... 10:29:31.372010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8459): Terminated: ok {rc=0} 10:29:31.462504 bus /sierra_3: Setting Powered False 10:29:32.561374 bus /sierra_3: Setting Powered False 10:29:33.677491 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:29:34.922953 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:29:34.932188 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:29:34.967139 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:29:34.994418 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:29:35.047780 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:29:35.081351 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:29:35.109255 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:29:35.660121 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:29:35.713601 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:29:35.725297 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:29:35.797471 tst mo_mt_call.py: using LAC 40303 10:29:35.925317 tst mo_mt_call.py: using RAC 13 10:29:36.061552 tst mo_mt_call.py: using CellId 40303 10:29:36.189442 tst mo_mt_call.py: using BVCI 40304 10:29:36.307523 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:29:36.319480 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:29:36.330920 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:29:36.342427 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:29:36.354441 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:29:36.366353 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:29:36.487751 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:29:36.607151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:37.079907 run create_hlr_db(pid=8465): Launched 10:29:37.197751 bus /sierra_2: Setting Powered False 10:29:38.258389 run create_hlr_db(pid=8465): Terminated: ok {rc=0} 10:29:38.685414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8467): Launched 10:29:38.992204 run osmo-hlr_10.42.42.2(pid=8468): Launched 10:29:39.108867 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:39.633542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8470): Launched 10:29:39.941164 run osmo-stp_10.42.42.5(pid=8471): Launched 10:29:40.060414 run osmo-msc_10.42.42.6: Starting osmo-msc 10:29:40.616102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8473): Launched 10:29:40.923560 run osmo-msc_10.42.42.6(pid=8474): Launched 10:29:41.095567 run osmo-stp_10.42.42.5(pid=8471): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8471)] 10:29:41.225817 run osmo-stp_10.42.42.5(pid=8471): stdout: | (launched: 2022-12-14_10:29:39.884517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:41.355545 run osmo-stp_10.42.42.5(pid=8471): stderr: | 20221214102940056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102940056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102940056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102940057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102940057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102940057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102940058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:41.484020 run osmo-stp_10.42.42.5(pid=8471): stdout: | (launched: 2022-12-14_10:29:39.884517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:41.606655 run osmo-stp_10.42.42.5(pid=8471): stderr: | 20221214102940056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102940056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102940056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102940057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102940057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102940057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102940058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:41.752644 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8471): Process ended prematurely: osmo-stp_10.42.42.5(pid=8471) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8471)] [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:29:41.761997 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:29:41.788734 run osmo-hlr_10.42.42.2(pid=8468): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8468)] 10:29:41.837883 run osmo-hlr_10.42.42.2(pid=8468): stdout: | (launched: 2022-12-14_10:29:38.935848) 10:29:41.888154 run osmo-hlr_10.42.42.2(pid=8468): stderr: | 20221214102939112 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102939112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102939112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102939112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102939112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102939112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102939125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102939133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102939133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102939133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:41.958778 run osmo-msc_10.42.42.6(pid=8474): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8474)] 10:29:42.006679 run osmo-msc_10.42.42.6(pid=8474): stdout: | (launched: 2022-12-14_10:29:40.867074) 10:29:42.056505 run osmo-msc_10.42.42.6(pid=8474): stderr: | 20221214102941137 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102941137 DLGLOBAL DEBUG validating counter group 0x7fe7aaa02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102941137 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102941137 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102941138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102941138 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102941140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102941140 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102941140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102941140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:29:42.106856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8467): Terminating (SIGTERM) 10:29:42.147387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8470): Terminating (SIGTERM) 10:29:42.187971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8473): Terminating (SIGTERM) 10:29:42.228576 --- ParallelTerminationStrategy: PID 8467 died... 10:29:42.248476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8467): Terminated: ok {rc=0} 10:29:42.293539 --- ParallelTerminationStrategy: PID 8470 died... 10:29:42.312844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8470): Terminated: ok {rc=0} 10:29:42.357443 --- ParallelTerminationStrategy: PID 8473 died... 10:29:42.376814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8473): Terminated: ok {rc=0} 10:29:42.462560 bus /sierra_3: Setting Powered False 10:29:43.562961 bus /sierra_3: Setting Powered False 10:29:44.682662 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:29:45.843526 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:29:45.860224 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:29:45.953752 tst mo_mt_call_osmux.py: using LAC 40304 10:29:46.083127 tst mo_mt_call_osmux.py: using RAC 14 10:29:46.243309 tst mo_mt_call_osmux.py: using CellId 40304 10:29:46.396119 tst mo_mt_call_osmux.py: using BVCI 40305 10:29:46.545330 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:29:46.560874 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:29:46.576874 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:29:46.593464 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:29:46.610355 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:29:46.626847 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:29:46.757034 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:29:46.882413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:47.400504 run create_hlr_db(pid=8476): Launched 10:29:47.534736 bus /sierra_2: Setting Powered False 10:29:48.599267 run create_hlr_db(pid=8476): Terminated: ok {rc=0} 10:29:49.037621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8478): Launched 10:29:49.344319 run osmo-hlr_10.42.42.2(pid=8479): Launched 10:29:49.462248 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:50.001697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8481): Launched 10:29:50.307688 run osmo-stp_10.42.42.5(pid=8482): Launched 10:29:50.425825 run osmo-msc_10.42.42.6: Starting osmo-msc 10:29:50.978816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8484): Launched 10:29:51.285663 run osmo-msc_10.42.42.6(pid=8485): Launched 10:29:51.457436 run osmo-stp_10.42.42.5(pid=8482): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8482)] 10:29:51.586958 run osmo-stp_10.42.42.5(pid=8482): stdout: | (launched: 2022-12-14_10:29:50.251097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:51.717178 run osmo-stp_10.42.42.5(pid=8482): stderr: | 20221214102950422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102950422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102950422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102950423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102950423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102950423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102950423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:51.844450 run osmo-stp_10.42.42.5(pid=8482): stdout: | (launched: 2022-12-14_10:29:50.251097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:51.966196 run osmo-stp_10.42.42.5(pid=8482): stderr: | 20221214102950422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214102950422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214102950422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214102950423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214102950423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214102950423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214102950423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:52.111714 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8482): Process ended prematurely: osmo-stp_10.42.42.5(pid=8482) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8482)] [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:29:52.120848 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:29:52.147790 run osmo-hlr_10.42.42.2(pid=8479): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8479)] 10:29:52.196548 run osmo-hlr_10.42.42.2(pid=8479): stdout: | (launched: 2022-12-14_10:29:49.287965) 10:29:52.246953 run osmo-hlr_10.42.42.2(pid=8479): stderr: | 20221214102949462 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214102949462 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214102949462 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214102949462 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214102949462 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214102949463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214102949479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214102949487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214102949487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214102949487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:52.317477 run osmo-msc_10.42.42.6(pid=8485): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8485)] 10:29:52.365384 run osmo-msc_10.42.42.6(pid=8485): stdout: | (launched: 2022-12-14_10:29:51.228825) 10:29:52.415617 run osmo-msc_10.42.42.6(pid=8485): stderr: | 20221214102951499 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214102951499 DLGLOBAL DEBUG validating counter group 0x7f62fb4c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214102951499 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214102951499 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214102951499 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214102951500 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214102951501 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214102951502 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214102951502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214102951502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:29:52.466435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8478): Terminating (SIGTERM) 10:29:52.507104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8481): Terminating (SIGTERM) 10:29:52.547515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8484): Terminating (SIGTERM) 10:29:52.588365 --- ParallelTerminationStrategy: PID 8478 died... 10:29:52.608412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8478): Terminated: ok {rc=0} 10:29:52.653286 --- ParallelTerminationStrategy: PID 8481 died... 10:29:52.672656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8481): Terminated: ok {rc=0} 10:29:52.717292 --- ParallelTerminationStrategy: PID 8484 died... 10:29:52.736306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8484): Terminated: ok {rc=0} 10:29:52.823533 bus /sierra_3: Setting Powered False 10:29:53.922843 bus /sierra_3: Setting Powered False 10:29:55.038856 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:29:56.286579 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:29:56.295064 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:29:56.328508 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:29:56.356024 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:29:56.409356 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:29:56.442649 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:29:56.470144 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:29:57.020364 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:29:57.073917 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:29:57.085804 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:29:57.156052 tst mo_mt_call.py: using LAC 40305 10:29:57.279655 tst mo_mt_call.py: using RAC 15 10:29:57.407320 tst mo_mt_call.py: using CellId 40305 10:29:57.535948 tst mo_mt_call.py: using BVCI 40306 10:29:57.655289 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:29:57.667357 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:29:57.679040 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:29:57.690683 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:29:57.702887 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:29:57.714514 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:29:57.831056 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:29:57.954590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:58.458888 run create_hlr_db(pid=8491): Launched 10:29:58.592623 bus /sierra_2: Setting Powered False 10:29:59.657655 run create_hlr_db(pid=8491): Terminated: ok {rc=0} 10:30:00.096354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8493): Launched 10:30:00.404632 run osmo-hlr_10.42.42.2(pid=8494): Launched 10:30:00.521201 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:01.089239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8496): Launched 10:30:01.425701 run osmo-stp_10.42.42.5(pid=8500): Launched 10:30:01.663730 run osmo-msc_10.42.42.6: Starting osmo-msc 10:30:02.296566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8502): Launched 10:30:02.618758 run osmo-msc_10.42.42.6(pid=8503): Launched 10:30:02.792835 run osmo-stp_10.42.42.5(pid=8500): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8500)] 10:30:02.924151 run osmo-stp_10.42.42.5(pid=8500): stdout: | (launched: 2022-12-14_10:30:01.364073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:03.054257 run osmo-stp_10.42.42.5(pid=8500): stderr: | 20221214103001599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103001600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103001600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103001600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103001601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103001601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103001601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:03.182405 run osmo-stp_10.42.42.5(pid=8500): stdout: | (launched: 2022-12-14_10:30:01.364073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:03.304288 run osmo-stp_10.42.42.5(pid=8500): stderr: | 20221214103001599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103001600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103001600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103001600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103001601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103001601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103001601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:03.450129 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8500): Process ended prematurely: osmo-stp_10.42.42.5(pid=8500) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8500)] [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:30:03.459055 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:30:03.485642 run osmo-hlr_10.42.42.2(pid=8494): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8494)] 10:30:03.533729 run osmo-hlr_10.42.42.2(pid=8494): stdout: | (launched: 2022-12-14_10:30:00.348121) 10:30:03.583276 run osmo-hlr_10.42.42.2(pid=8494): stderr: | 20221214103000526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103000526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103000526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103000527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103000527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103000527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103000541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103000551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103000552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103000552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:03.652628 run osmo-msc_10.42.42.6(pid=8503): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8503)] 10:30:03.700320 run osmo-msc_10.42.42.6(pid=8503): stdout: | (launched: 2022-12-14_10:30:02.562095) 10:30:03.749835 run osmo-msc_10.42.42.6(pid=8503): stderr: | 20221214103002834 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103002834 DLGLOBAL DEBUG validating counter group 0x7f737371cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103002834 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103002834 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103002834 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103002834 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103002836 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103002836 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103002837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103002837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:30:03.800289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8493): Terminating (SIGTERM) 10:30:03.840414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8496): Terminating (SIGTERM) 10:30:03.880274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8502): Terminating (SIGTERM) 10:30:03.920280 --- ParallelTerminationStrategy: PID 8493 died... 10:30:03.939650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8493): Terminated: ok {rc=0} 10:30:03.983898 --- ParallelTerminationStrategy: PID 8496 died... 10:30:04.002797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8496): Terminated: ok {rc=0} 10:30:04.046985 --- ParallelTerminationStrategy: PID 8502 died... 10:30:04.065985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8502): Terminated: ok {rc=0} 10:30:04.152611 bus /sierra_3: Setting Powered False 10:30:05.251760 bus /sierra_3: Setting Powered False 10:30:06.368183 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:30:07.515342 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:30:07.527141 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:30:07.595741 tst mo_mt_call_osmux.py: using LAC 40306 10:30:07.713364 tst mo_mt_call_osmux.py: using RAC 16 10:30:07.831922 tst mo_mt_call_osmux.py: using CellId 40306 10:30:07.949591 tst mo_mt_call_osmux.py: using BVCI 40307 10:30:08.062728 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:30:08.073829 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:30:08.084994 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:30:08.095881 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:30:08.107288 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:30:08.118543 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:30:08.240177 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:30:08.362178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:08.836197 run create_hlr_db(pid=8505): Launched 10:30:08.953226 bus /sierra_2: Setting Powered False 10:30:10.014301 run create_hlr_db(pid=8505): Terminated: ok {rc=0} 10:30:10.461854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8507): Launched 10:30:10.789392 run osmo-hlr_10.42.42.2(pid=8508): Launched 10:30:10.914329 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:11.474299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8510): Launched 10:30:11.801960 run osmo-stp_10.42.42.5(pid=8511): Launched 10:30:11.928329 run osmo-msc_10.42.42.6: Starting osmo-msc 10:30:12.518344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8513): Launched 10:30:12.845168 run osmo-msc_10.42.42.6(pid=8514): Launched 10:30:13.026858 run osmo-stp_10.42.42.5(pid=8511): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8511)] 10:30:13.164110 run osmo-stp_10.42.42.5(pid=8511): stdout: | (launched: 2022-12-14_10:30:11.741464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:13.301681 run osmo-stp_10.42.42.5(pid=8511): stderr: | 20221214103011935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103011935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103011935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103011936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103011936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103011936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103011936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:13.438302 run osmo-stp_10.42.42.5(pid=8511): stdout: | (launched: 2022-12-14_10:30:11.741464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:13.567291 run osmo-stp_10.42.42.5(pid=8511): stderr: | 20221214103011935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103011935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103011935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103011936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103011936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103011936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103011936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:13.722588 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8511): Process ended prematurely: osmo-stp_10.42.42.5(pid=8511) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8511)] [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:30:13.732344 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:30:13.760797 run osmo-hlr_10.42.42.2(pid=8508): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8508)] 10:30:13.812055 run osmo-hlr_10.42.42.2(pid=8508): stdout: | (launched: 2022-12-14_10:30:10.729550) 10:30:13.864901 run osmo-hlr_10.42.42.2(pid=8508): stderr: | 20221214103010928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103010928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103010928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103010928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103010928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103010928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103010940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103010948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103010949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103010949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:13.938572 run osmo-msc_10.42.42.6(pid=8514): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8514)] 10:30:13.989504 run osmo-msc_10.42.42.6(pid=8514): stdout: | (launched: 2022-12-14_10:30:12.785028) 10:30:14.041955 run osmo-msc_10.42.42.6(pid=8514): stderr: | 20221214103013106 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103013107 DLGLOBAL DEBUG validating counter group 0x7ff6ae5b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103013107 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103013107 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103013107 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103013107 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103013109 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103013109 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103013109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103013109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:30:14.094783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8507): Terminating (SIGTERM) 10:30:14.137137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8510): Terminating (SIGTERM) 10:30:14.179559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8513): Terminating (SIGTERM) 10:30:14.222484 --- ParallelTerminationStrategy: PID 8507 died... 10:30:14.243054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8507): Terminated: ok {rc=0} 10:30:14.290103 --- ParallelTerminationStrategy: PID 8510 died... 10:30:14.310099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8510): Terminated: ok {rc=0} 10:30:14.356748 --- ParallelTerminationStrategy: PID 8513 died... 10:30:14.376682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8513): Terminated: ok {rc=0} 10:30:14.465957 bus /sierra_3: Setting Powered False 10:30:15.566485 bus /sierra_3: Setting Powered False 10:30:16.686991 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:30:17.945980 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:30:17.953245 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:30:17.986743 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:30:18.014447 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:30:18.067327 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:30:18.100278 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:30:18.128143 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:30:18.680572 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:30:18.733963 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:30:18.745722 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:30:18.817549 tst mo_mt_call.py: using LAC 40307 10:30:18.941034 tst mo_mt_call.py: using RAC 17 10:30:19.069575 tst mo_mt_call.py: using CellId 40307 10:30:19.191315 tst mo_mt_call.py: using BVCI 40308 10:30:19.311087 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:30:19.322694 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:30:19.334127 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:30:19.345607 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:30:19.357226 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:30:19.368637 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:30:19.487715 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:30:19.607450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:20.079796 run create_hlr_db(pid=8521): Launched 10:30:20.197643 bus /sierra_2: Setting Powered False 10:30:21.258038 run create_hlr_db(pid=8521): Terminated: ok {rc=0} 10:30:21.683596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8523): Launched 10:30:21.990008 run osmo-hlr_10.42.42.2(pid=8524): Launched 10:30:22.106944 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:22.644568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8526): Launched 10:30:22.949484 run osmo-stp_10.42.42.5(pid=8527): Launched 10:30:23.067578 run osmo-msc_10.42.42.6: Starting osmo-msc 10:30:23.616847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8529): Launched 10:30:23.921921 run osmo-msc_10.42.42.6(pid=8530): Launched 10:30:24.094352 run osmo-stp_10.42.42.5(pid=8527): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8527)] 10:30:24.223187 run osmo-stp_10.42.42.5(pid=8527): stdout: | (launched: 2022-12-14_10:30:22.893352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:24.351764 run osmo-stp_10.42.42.5(pid=8527): stderr: | 20221214103023066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103023066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103023066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103023066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103023067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103023067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103023067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:24.478501 run osmo-stp_10.42.42.5(pid=8527): stdout: | (launched: 2022-12-14_10:30:22.893352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:24.598934 run osmo-stp_10.42.42.5(pid=8527): stderr: | 20221214103023066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103023066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103023066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103023066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103023067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103023067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103023067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:24.743442 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8527): Process ended prematurely: osmo-stp_10.42.42.5(pid=8527) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8527)] [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:30:24.752632 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:30:24.779345 run osmo-hlr_10.42.42.2(pid=8524): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8524)] 10:30:24.827984 run osmo-hlr_10.42.42.2(pid=8524): stdout: | (launched: 2022-12-14_10:30:21.933684) 10:30:24.877903 run osmo-hlr_10.42.42.2(pid=8524): stderr: | 20221214103022109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103022109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103022109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103022109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103022109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103022109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103022124 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103022134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103022134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103022134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:24.947619 run osmo-msc_10.42.42.6(pid=8530): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8530)] 10:30:24.995872 run osmo-msc_10.42.42.6(pid=8530): stdout: | (launched: 2022-12-14_10:30:23.865337) 10:30:25.045924 run osmo-msc_10.42.42.6(pid=8530): stderr: | 20221214103024137 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103024138 DLGLOBAL DEBUG validating counter group 0x7f146310dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103024138 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103024138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103024138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103024138 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103024140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103024140 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103024140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103024140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:30:25.095986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8523): Terminating (SIGTERM) 10:30:25.136288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8526): Terminating (SIGTERM) 10:30:25.176438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8529): Terminating (SIGTERM) 10:30:25.216749 --- ParallelTerminationStrategy: PID 8523 died... 10:30:25.236137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8523): Terminated: ok {rc=0} 10:30:25.280907 --- ParallelTerminationStrategy: PID 8526 died... 10:30:25.300442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8526): Terminated: ok {rc=0} 10:30:25.344514 --- ParallelTerminationStrategy: PID 8529 died... 10:30:25.363635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8529): Terminated: ok {rc=0} 10:30:25.450453 bus /sierra_3: Setting Powered False 10:30:26.551030 bus /sierra_3: Setting Powered False 10:30:27.668929 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:30:28.820647 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:30:28.832863 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:30:28.903713 tst mo_mt_call_osmux.py: using LAC 40308 10:30:29.032562 tst mo_mt_call_osmux.py: using RAC 18 10:30:29.159754 tst mo_mt_call_osmux.py: using CellId 40308 10:30:29.286263 tst mo_mt_call_osmux.py: using BVCI 40309 10:30:29.403591 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:30:29.415167 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:30:29.426953 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:30:29.438499 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:30:29.450084 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:30:29.461468 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:30:29.581548 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:30:29.700619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:30.173767 run create_hlr_db(pid=8532): Launched 10:30:30.291647 bus /sierra_2: Setting Powered False 10:30:31.353946 run create_hlr_db(pid=8532): Terminated: ok {rc=0} 10:30:31.829750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8534): Launched 10:30:32.160763 run osmo-hlr_10.42.42.2(pid=8535): Launched 10:30:32.313681 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:32.876057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8537): Launched 10:30:33.204285 run osmo-stp_10.42.42.5(pid=8538): Launched 10:30:33.331080 run osmo-msc_10.42.42.6: Starting osmo-msc 10:30:33.926327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8540): Launched 10:30:34.255178 run osmo-msc_10.42.42.6(pid=8541): Launched 10:30:34.438568 run osmo-stp_10.42.42.5(pid=8538): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8538)] 10:30:34.575529 run osmo-stp_10.42.42.5(pid=8538): stdout: | (launched: 2022-12-14_10:30:33.144549) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:34.713206 run osmo-stp_10.42.42.5(pid=8538): stderr: | 20221214103033336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103033337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103033337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103033337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103033338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103033338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103033338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:34.850791 run osmo-stp_10.42.42.5(pid=8538): stdout: | (launched: 2022-12-14_10:30:33.144549) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:34.980078 run osmo-stp_10.42.42.5(pid=8538): stderr: | 20221214103033336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103033337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103033337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103033337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103033338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103033338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103033338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:35.135421 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8538): Process ended prematurely: osmo-stp_10.42.42.5(pid=8538) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8538)] [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:30:35.145226 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:30:35.173319 run osmo-hlr_10.42.42.2(pid=8535): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8535)] 10:30:35.223862 run osmo-hlr_10.42.42.2(pid=8535): stdout: | (launched: 2022-12-14_10:30:32.102978) 10:30:35.276036 run osmo-hlr_10.42.42.2(pid=8535): stderr: | 20221214103032320 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103032320 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103032320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103032320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103032320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103032320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103032332 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103032341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103032341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103032341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:35.349370 run osmo-msc_10.42.42.6(pid=8541): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8541)] 10:30:35.399800 run osmo-msc_10.42.42.6(pid=8541): stdout: | (launched: 2022-12-14_10:30:34.195303) 10:30:35.451862 run osmo-msc_10.42.42.6(pid=8541): stderr: | 20221214103034517 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103034517 DLGLOBAL DEBUG validating counter group 0x7f2fc3778c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103034517 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103034517 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103034517 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103034518 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103034520 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103034520 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103034520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103034520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:30:35.504281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8534): Terminating (SIGTERM) 10:30:35.546668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8537): Terminating (SIGTERM) 10:30:35.588743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8540): Terminating (SIGTERM) 10:30:35.631649 --- ParallelTerminationStrategy: PID 8534 died... 10:30:35.652200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8534): Terminated: ok {rc=0} 10:30:35.698960 --- ParallelTerminationStrategy: PID 8537 died... 10:30:35.718958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8537): Terminated: ok {rc=0} 10:30:35.765275 --- ParallelTerminationStrategy: PID 8540 died... 10:30:35.785196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8540): Terminated: ok {rc=0} 10:30:35.873792 bus /sierra_3: Setting Powered False 10:30:36.972785 bus /sierra_3: Setting Powered False 10:30:38.090618 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:30:39.349803 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:30:39.356928 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:30:39.390044 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:30:39.417384 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:30:39.470213 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:30:39.503092 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:30:39.530217 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:30:40.082855 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:30:40.135180 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:30:40.146958 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:30:40.217124 tst mo_mt_call.py: using LAC 40309 10:30:40.344173 tst mo_mt_call.py: using RAC 19 10:30:40.471510 tst mo_mt_call.py: using CellId 40309 10:30:40.598770 tst mo_mt_call.py: using BVCI 40310 10:30:40.718138 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:30:40.730158 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:30:40.741747 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:30:40.753255 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:30:40.764783 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:30:40.776414 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:30:40.897679 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:30:41.016609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:41.491005 run create_hlr_db(pid=8546): Launched 10:30:41.608787 bus /sierra_2: Setting Powered False 10:30:42.669758 run create_hlr_db(pid=8546): Terminated: ok {rc=0} 10:30:43.116419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8548): Launched 10:30:43.443856 run osmo-hlr_10.42.42.2(pid=8549): Launched 10:30:43.571728 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:44.134040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8551): Launched 10:30:44.460010 run osmo-stp_10.42.42.5(pid=8552): Launched 10:30:44.584184 run osmo-msc_10.42.42.6: Starting osmo-msc 10:30:45.173198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8554): Launched 10:30:45.500830 run osmo-msc_10.42.42.6(pid=8555): Launched 10:30:45.683019 run osmo-stp_10.42.42.5(pid=8552): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8552)] 10:30:45.821544 run osmo-stp_10.42.42.5(pid=8552): stdout: | (launched: 2022-12-14_10:30:44.400050) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:46.101669 run osmo-stp_10.42.42.5(pid=8552): stderr: | 20221214103044592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103044592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103044592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103044593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103044593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103044593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103044593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:46.236614 run osmo-stp_10.42.42.5(pid=8552): stdout: | (launched: 2022-12-14_10:30:44.400050) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:46.362547 run osmo-stp_10.42.42.5(pid=8552): stderr: | 20221214103044592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103044592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103044592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103044593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103044593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103044593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103044593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:46.514071 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8552): Process ended prematurely: osmo-stp_10.42.42.5(pid=8552) [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8552)] [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:30:46.524214 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:30:46.552920 run osmo-hlr_10.42.42.2(pid=8549): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8549)] 10:30:46.604676 run osmo-hlr_10.42.42.2(pid=8549): stdout: | (launched: 2022-12-14_10:30:43.383883) 10:30:46.658489 run osmo-hlr_10.42.42.2(pid=8549): stderr: | 20221214103043583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103043583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103043583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103043583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103043583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103043583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103043596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103043606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103043606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103043606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:46.731472 run osmo-msc_10.42.42.6(pid=8555): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8555)] 10:30:46.780825 run osmo-msc_10.42.42.6(pid=8555): stdout: | (launched: 2022-12-14_10:30:45.440839) 10:30:46.835628 run osmo-msc_10.42.42.6(pid=8555): stderr: | 20221214103045763 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103045763 DLGLOBAL DEBUG validating counter group 0x7fbccdea8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103045763 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103045763 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103045764 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103045764 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103045765 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103045766 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103045766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103045766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:30:46.888523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8548): Terminating (SIGTERM) 10:30:46.930583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8551): Terminating (SIGTERM) 10:30:46.975668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8554): Terminating (SIGTERM) 10:30:47.021932 --- ParallelTerminationStrategy: PID 8548 died... 10:30:47.043068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8548): Terminated: ok {rc=0} 10:30:47.091137 --- ParallelTerminationStrategy: PID 8551 died... 10:30:47.112257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8551): Terminated: ok {rc=0} 10:30:47.158980 --- ParallelTerminationStrategy: PID 8554 died... 10:30:47.180060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8554): Terminated: ok {rc=0} 10:30:47.270537 bus /sierra_3: Setting Powered False 10:30:48.370563 bus /sierra_3: Setting Powered False 10:30:49.485862 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:30:50.635929 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:30:50.648398 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:30:50.723746 tst mo_mt_call_osmux.py: using LAC 40310 10:30:50.851133 tst mo_mt_call_osmux.py: using RAC 20 10:30:50.976467 tst mo_mt_call_osmux.py: using CellId 40310 10:30:51.102483 tst mo_mt_call_osmux.py: using BVCI 40311 10:30:51.220148 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:30:51.231941 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:30:51.243481 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:30:51.255038 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:30:51.266669 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:30:51.278258 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:30:51.396594 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:30:51.517037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:52.023357 run create_hlr_db(pid=8558): Launched 10:30:52.156919 bus /sierra_2: Setting Powered False 10:30:53.221775 run create_hlr_db(pid=8558): Terminated: ok {rc=0} 10:30:53.657514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8560): Launched 10:30:53.964077 run osmo-hlr_10.42.42.2(pid=8561): Launched 10:30:54.080656 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:54.620501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8563): Launched 10:30:54.925922 run osmo-stp_10.42.42.5(pid=8564): Launched 10:30:55.041917 run osmo-msc_10.42.42.6: Starting osmo-msc 10:30:55.590970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8566): Launched 10:30:55.896177 run osmo-msc_10.42.42.6(pid=8567): Launched 10:30:56.067282 run osmo-stp_10.42.42.5(pid=8564): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8564)] 10:30:56.196348 run osmo-stp_10.42.42.5(pid=8564): stdout: | (launched: 2022-12-14_10:30:54.869768) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:56.325078 run osmo-stp_10.42.42.5(pid=8564): stderr: | 20221214103055042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103055042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103055042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103055043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103055043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103055043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103055043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:56.451887 run osmo-stp_10.42.42.5(pid=8564): stdout: | (launched: 2022-12-14_10:30:54.869768) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:56.572477 run osmo-stp_10.42.42.5(pid=8564): stderr: | 20221214103055042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103055042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103055042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103055043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103055043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103055043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103055043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:56.717242 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8564): Process ended prematurely: osmo-stp_10.42.42.5(pid=8564) [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8564)] [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:30:56.726342 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:30:56.752804 run osmo-hlr_10.42.42.2(pid=8561): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8561)] 10:30:56.801375 run osmo-hlr_10.42.42.2(pid=8561): stdout: | (launched: 2022-12-14_10:30:53.907829) 10:30:56.851125 run osmo-hlr_10.42.42.2(pid=8561): stderr: | 20221214103054083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103054083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103054083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103054083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103054083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103054083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103054095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103054104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103054105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103054105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:56.920846 run osmo-msc_10.42.42.6(pid=8567): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8567)] 10:30:56.968248 run osmo-msc_10.42.42.6(pid=8567): stdout: | (launched: 2022-12-14_10:30:55.839779) 10:30:57.017805 run osmo-msc_10.42.42.6(pid=8567): stderr: | 20221214103056112 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103056112 DLGLOBAL DEBUG validating counter group 0x7f3c93021c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103056112 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103056112 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103056112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103056112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103056114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103056114 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103056115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103056115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:30:57.067446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8560): Terminating (SIGTERM) 10:30:57.107481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8563): Terminating (SIGTERM) 10:30:57.147449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8566): Terminating (SIGTERM) 10:30:57.187680 --- ParallelTerminationStrategy: PID 8560 died... 10:30:57.207295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8560): Terminated: ok {rc=0} 10:30:57.251510 --- ParallelTerminationStrategy: PID 8563 died... 10:30:57.270491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8563): Terminated: ok {rc=0} 10:30:57.314667 --- ParallelTerminationStrategy: PID 8566 died... 10:30:57.333550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8566): Terminated: ok {rc=0} 10:30:57.419930 bus /sierra_3: Setting Powered False 10:30:58.519505 bus /sierra_3: Setting Powered False 10:30:59.635204 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:31:00.904487 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:31:00.910703 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:31:00.943489 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:31:00.974221 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:31:01.032808 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:31:01.067397 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:31:01.096061 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:31:01.659920 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:31:01.726388 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:31:01.740708 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:31:01.817934 tst mo_mt_call.py: using LAC 40311 10:31:01.991454 tst mo_mt_call.py: using RAC 21 10:31:02.147686 tst mo_mt_call.py: using CellId 40311 10:31:02.271348 tst mo_mt_call.py: using BVCI 40312 10:31:02.384733 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:31:02.396410 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:31:02.407741 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:31:02.419073 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:31:02.431319 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:31:02.443095 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:31:02.564209 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:31:02.684640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:03.188097 run create_hlr_db(pid=8572): Launched 10:31:03.322891 bus /sierra_2: Setting Powered False 10:31:04.387049 run create_hlr_db(pid=8572): Terminated: ok {rc=0} 10:31:04.824089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8574): Launched 10:31:05.129618 run osmo-hlr_10.42.42.2(pid=8575): Launched 10:31:05.246306 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:05.784566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8577): Launched 10:31:06.090636 run osmo-stp_10.42.42.5(pid=8578): Launched 10:31:06.206742 run osmo-msc_10.42.42.6: Starting osmo-msc 10:31:06.757480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8580): Launched 10:31:07.063128 run osmo-msc_10.42.42.6(pid=8581): Launched 10:31:07.233550 run osmo-stp_10.42.42.5(pid=8578): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8578)] 10:31:07.362816 run osmo-stp_10.42.42.5(pid=8578): stdout: | (launched: 2022-12-14_10:31:06.033882) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:07.491807 run osmo-stp_10.42.42.5(pid=8578): stderr: | 20221214103106206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103106206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103106206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103106207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103106207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103106207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103106207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:07.619019 run osmo-stp_10.42.42.5(pid=8578): stdout: | (launched: 2022-12-14_10:31:06.033882) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:07.739500 run osmo-stp_10.42.42.5(pid=8578): stderr: | 20221214103106206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103106206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103106206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103106207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103106207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103106207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103106207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:07.884351 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8578): Process ended prematurely: osmo-stp_10.42.42.5(pid=8578) [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8578)] [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:31:07.893424 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:31:07.920194 run osmo-hlr_10.42.42.2(pid=8575): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8575)] 10:31:07.968458 run osmo-hlr_10.42.42.2(pid=8575): stdout: | (launched: 2022-12-14_10:31:05.073539) 10:31:08.018613 run osmo-hlr_10.42.42.2(pid=8575): stderr: | 20221214103105250 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103105250 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103105250 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103105250 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103105250 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103105250 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103105262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103105271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103105272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103105272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:08.088652 run osmo-msc_10.42.42.6(pid=8581): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8581)] 10:31:08.136616 run osmo-msc_10.42.42.6(pid=8581): stdout: | (launched: 2022-12-14_10:31:07.006609) 10:31:08.186416 run osmo-msc_10.42.42.6(pid=8581): stderr: | 20221214103107277 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103107278 DLGLOBAL DEBUG validating counter group 0x7fca1603bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103107278 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103107278 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103107278 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103107278 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103107280 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103107280 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103107280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103107280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:31:08.236853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8574): Terminating (SIGTERM) 10:31:08.277049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8577): Terminating (SIGTERM) 10:31:08.317278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8580): Terminating (SIGTERM) 10:31:08.357981 --- ParallelTerminationStrategy: PID 8574 died... 10:31:08.377814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8574): Terminated: ok {rc=0} 10:31:08.422380 --- ParallelTerminationStrategy: PID 8577 died... 10:31:08.441442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8577): Terminated: ok {rc=0} 10:31:08.485770 --- ParallelTerminationStrategy: PID 8580 died... 10:31:08.504803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8580): Terminated: ok {rc=0} 10:31:08.589284 bus /sierra_3: Setting Powered False 10:31:09.687579 bus /sierra_3: Setting Powered False 10:31:10.806999 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:31:11.954927 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:31:11.966770 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:31:12.036554 tst mo_mt_call_osmux.py: using LAC 40312 10:31:12.157642 tst mo_mt_call_osmux.py: using RAC 22 10:31:12.286825 tst mo_mt_call_osmux.py: using CellId 40312 10:31:12.416603 tst mo_mt_call_osmux.py: using BVCI 40313 10:31:12.536329 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:31:12.547752 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:31:12.559385 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:31:12.570683 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:31:12.582022 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:31:12.593390 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:31:12.712099 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:31:12.828619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:13.302946 run create_hlr_db(pid=8583): Launched 10:31:13.422492 bus /sierra_2: Setting Powered False 10:31:14.483514 run create_hlr_db(pid=8583): Terminated: ok {rc=0} 10:31:14.911118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8585): Launched 10:31:15.218879 run osmo-hlr_10.42.42.2(pid=8586): Launched 10:31:15.335954 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:15.905154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8588): Launched 10:31:16.241713 run osmo-stp_10.42.42.5(pid=8589): Launched 10:31:16.533231 run osmo-msc_10.42.42.6: Starting osmo-msc 10:31:17.102555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8591): Launched 10:31:17.427238 run osmo-msc_10.42.42.6(pid=8592): Launched 10:31:17.599533 run osmo-stp_10.42.42.5(pid=8589): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8589)] 10:31:17.729617 run osmo-stp_10.42.42.5(pid=8589): stdout: | (launched: 2022-12-14_10:31:16.181489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:17.859498 run osmo-stp_10.42.42.5(pid=8589): stderr: | 20221214103116375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103116375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103116375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103116376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103116377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103116377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103116377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:17.987585 run osmo-stp_10.42.42.5(pid=8589): stdout: | (launched: 2022-12-14_10:31:16.181489) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:18.109252 run osmo-stp_10.42.42.5(pid=8589): stderr: | 20221214103116375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103116375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103116375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103116376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103116377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103116377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103116377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:18.254514 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8589): Process ended prematurely: osmo-stp_10.42.42.5(pid=8589) [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8589)] [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:31:18.263684 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:31:18.290600 run osmo-hlr_10.42.42.2(pid=8586): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8586)] 10:31:18.339180 run osmo-hlr_10.42.42.2(pid=8586): stdout: | (launched: 2022-12-14_10:31:15.162301) 10:31:18.388737 run osmo-hlr_10.42.42.2(pid=8586): stderr: | 20221214103115336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103115336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103115336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103115336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103115336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103115336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103115348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103115356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103115357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103115357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:18.458544 run osmo-msc_10.42.42.6(pid=8592): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8592)] 10:31:18.505990 run osmo-msc_10.42.42.6(pid=8592): stdout: | (launched: 2022-12-14_10:31:17.370270) 10:31:18.555661 run osmo-msc_10.42.42.6(pid=8592): stderr: | 20221214103117642 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103117642 DLGLOBAL DEBUG validating counter group 0x7f8aedc98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103117642 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103117642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103117642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103117643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103117644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103117645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103117645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103117645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:31:18.605768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8585): Terminating (SIGTERM) 10:31:18.646115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8588): Terminating (SIGTERM) 10:31:18.686406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8591): Terminating (SIGTERM) 10:31:18.726849 --- ParallelTerminationStrategy: PID 8585 died... 10:31:18.746617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8585): Terminated: ok {rc=0} 10:31:18.791000 --- ParallelTerminationStrategy: PID 8588 died... 10:31:18.810224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8588): Terminated: ok {rc=0} 10:31:18.855302 --- ParallelTerminationStrategy: PID 8591 died... 10:31:18.874440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8591): Terminated: ok {rc=0} 10:31:18.961047 bus /sierra_3: Setting Powered False 10:31:20.060428 bus /sierra_3: Setting Powered False 10:31:21.177654 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:31:22.429126 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:31:22.435874 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:31:22.469026 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 10:31:22.496829 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 10:31:22.550144 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:31:22.583528 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 10:31:22.610945 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 10:31:23.160050 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 10:31:23.209472 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:31:23.221025 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:31:23.272425 tst mo_mt_call.py: using LAC 40313 10:31:23.396422 tst mo_mt_call.py: using RAC 23 10:31:23.526404 tst mo_mt_call.py: using CellId 40313 10:31:23.648766 tst mo_mt_call.py: using BVCI 40314 10:31:23.760763 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:31:23.772233 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:31:23.783660 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:31:23.794808 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:31:23.806471 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:31:23.818070 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:31:23.938931 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:31:24.056681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:24.530699 run create_hlr_db(pid=8597): Launched 10:31:24.647781 bus /sierra_2: Setting Powered False 10:31:25.708303 run create_hlr_db(pid=8597): Terminated: ok {rc=0} 10:31:26.155923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8599): Launched 10:31:26.485729 run osmo-hlr_10.42.42.2(pid=8600): Launched 10:31:26.612758 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:27.179906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8602): Launched 10:31:27.507997 run osmo-stp_10.42.42.5(pid=8603): Launched 10:31:27.632438 run osmo-msc_10.42.42.6: Starting osmo-msc 10:31:28.221780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8605): Launched 10:31:28.549134 run osmo-msc_10.42.42.6(pid=8606): Launched 10:31:28.732797 run osmo-stp_10.42.42.5(pid=8603): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8603)] 10:31:28.870244 run osmo-stp_10.42.42.5(pid=8603): stdout: | (launched: 2022-12-14_10:31:27.448029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:29.008166 run osmo-stp_10.42.42.5(pid=8603): stderr: | 20221214103127640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103127640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103127640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103127641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103127641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103127641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103127641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:29.145280 run osmo-stp_10.42.42.5(pid=8603): stdout: | (launched: 2022-12-14_10:31:27.448029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:29.274622 run osmo-stp_10.42.42.5(pid=8603): stderr: | 20221214103127640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103127640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103127640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103127641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103127641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103127641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103127641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:29.429754 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8603): Process ended prematurely: osmo-stp_10.42.42.5(pid=8603) [trial-2403↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8603)] [trial-2403↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 10:31:29.439518 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:31:29.467995 run osmo-hlr_10.42.42.2(pid=8600): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8600)] 10:31:29.518712 run osmo-hlr_10.42.42.2(pid=8600): stdout: | (launched: 2022-12-14_10:31:26.426064) 10:31:29.571364 run osmo-hlr_10.42.42.2(pid=8600): stderr: | 20221214103126624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103126624 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103126624 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103126624 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103126624 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103126624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103126637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103126645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103126646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103126646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:29.645424 run osmo-msc_10.42.42.6(pid=8606): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8606)] 10:31:29.695963 run osmo-msc_10.42.42.6(pid=8606): stdout: | (launched: 2022-12-14_10:31:28.489144) 10:31:29.748709 run osmo-msc_10.42.42.6(pid=8606): stderr: | 20221214103128813 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103128813 DLGLOBAL DEBUG validating counter group 0x7f0122902c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103128813 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103128813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103128813 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103128814 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103128815 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103128816 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103128816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103128816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:31:29.801769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8599): Terminating (SIGTERM) 10:31:29.844111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8602): Terminating (SIGTERM) 10:31:29.886513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8605): Terminating (SIGTERM) 10:31:29.929145 --- ParallelTerminationStrategy: PID 8599 died... 10:31:29.949608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8599): Terminated: ok {rc=0} 10:31:29.996456 --- ParallelTerminationStrategy: PID 8602 died... 10:31:30.016471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8602): Terminated: ok {rc=0} 10:31:30.063060 --- ParallelTerminationStrategy: PID 8605 died... 10:31:30.082976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8605): Terminated: ok {rc=0} 10:31:30.170998 bus /sierra_3: Setting Powered False 10:31:31.276196 bus /sierra_3: Setting Powered False 10:31:32.404306 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 10:31:33.555112 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:31:33.567730 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:31:33.622026 tst mo_mt_call_osmux.py: using LAC 40314 10:31:33.751163 tst mo_mt_call_osmux.py: using RAC 24 10:31:33.884306 tst mo_mt_call_osmux.py: using CellId 40314 10:31:34.013077 tst mo_mt_call_osmux.py: using BVCI 40315 10:31:34.131417 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:31:34.143221 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:31:34.154893 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:31:34.166534 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:31:34.178481 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:31:34.190286 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:31:34.309146 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:31:34.431628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:34.937582 run create_hlr_db(pid=8608): Launched 10:31:35.072251 bus /sierra_2: Setting Powered False 10:31:36.137148 run create_hlr_db(pid=8608): Terminated: ok {rc=0} 10:31:36.581742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8610): Launched 10:31:36.889066 run osmo-hlr_10.42.42.2(pid=8611): Launched 10:31:37.006373 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:37.549241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8613): Launched 10:31:37.857920 run osmo-stp_10.42.42.5(pid=8614): Launched 10:31:37.974815 run osmo-msc_10.42.42.6: Starting osmo-msc 10:31:38.529355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8616): Launched 10:31:38.839424 run osmo-msc_10.42.42.6(pid=8617): Launched 10:31:39.013215 run osmo-stp_10.42.42.5(pid=8614): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8614)] 10:31:39.142862 run osmo-stp_10.42.42.5(pid=8614): stdout: | (launched: 2022-12-14_10:31:37.800734) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:39.272890 run osmo-stp_10.42.42.5(pid=8614): stderr: | 20221214103137971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103137971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103137971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103137972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103137972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103137972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103137972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:39.401536 run osmo-stp_10.42.42.5(pid=8614): stdout: | (launched: 2022-12-14_10:31:37.800734) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:39.523107 run osmo-stp_10.42.42.5(pid=8614): stderr: | 20221214103137971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103137971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103137971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103137972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103137972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103137972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103137972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:39.668636 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8614): Process ended prematurely: osmo-stp_10.42.42.5(pid=8614) [trial-2403↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8614)] [trial-2403↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 10:31:39.678044 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:31:39.704594 run osmo-hlr_10.42.42.2(pid=8611): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8611)] 10:31:39.753405 run osmo-hlr_10.42.42.2(pid=8611): stdout: | (launched: 2022-12-14_10:31:36.832324) 10:31:39.803574 run osmo-hlr_10.42.42.2(pid=8611): stderr: | 20221214103137006 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103137006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103137006 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103137006 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103137006 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103137006 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103137023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103137032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103137032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103137032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:39.873544 run osmo-msc_10.42.42.6(pid=8617): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8617)] 10:31:39.921240 run osmo-msc_10.42.42.6(pid=8617): stdout: | (launched: 2022-12-14_10:31:38.782165) 10:31:39.972048 run osmo-msc_10.42.42.6(pid=8617): stderr: | 20221214103139051 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103139051 DLGLOBAL DEBUG validating counter group 0x7f247b3fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103139052 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103139052 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103139052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103139052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103139054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103139054 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103139054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103139054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:31:40.022111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8610): Terminating (SIGTERM) 10:31:40.062416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8613): Terminating (SIGTERM) 10:31:40.102608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8616): Terminating (SIGTERM) 10:31:40.143088 --- ParallelTerminationStrategy: PID 8610 died... 10:31:40.162838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8610): Terminated: ok {rc=0} 10:31:40.207205 --- ParallelTerminationStrategy: PID 8613 died... 10:31:40.226284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8613): Terminated: ok {rc=0} 10:31:40.270438 --- ParallelTerminationStrategy: PID 8616 died... 10:31:40.289476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8616): Terminated: ok {rc=0} 10:31:40.374097 bus /sierra_3: Setting Powered False 10:31:41.473263 bus /sierra_3: Setting Powered False 10:31:42.591234 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 emergency:trx-umtrx --------------------------------------------------------------------- 10:31:43.846004 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:31:43.850889 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:31:43.884057 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 10:31:43.912066 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 10:31:43.999119 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:31:44.032219 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 10:31:44.059613 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 10:31:44.638906 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2403 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 10:31:44.644275 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:31:44.655070 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 10:31:44.703727 tst emergency_mo_mt_call.py: using LAC 40315 10:31:44.821278 tst emergency_mo_mt_call.py: using RAC 25 10:31:44.943521 tst emergency_mo_mt_call.py: using CellId 40315 10:31:45.068696 tst emergency_mo_mt_call.py: using BVCI 40316 10:31:45.184625 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:31:45.195887 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:31:45.207055 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:31:45.218241 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:31:45.229169 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:31:45.239997 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:31:45.356754 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:31:45.478302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:45.996371 run create_hlr_db(pid=8622): Launched 10:31:46.127229 bus /sierra_2: Setting Powered False 10:31:47.189165 run create_hlr_db(pid=8622): Terminated: ok {rc=0} 10:31:47.623611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8624): Launched 10:31:47.925495 run osmo-hlr_10.42.42.2(pid=8625): Launched 10:31:48.040139 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:48.560092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8627): Launched 10:31:48.862464 run osmo-stp_10.42.42.5(pid=8628): Launched 10:31:48.989156 tst emergency_mo_mt_call.py: using MSISDN 8638 10:31:49.153223 run osmo-msc_10.42.42.6: Starting osmo-msc 10:31:49.695738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8630): Launched 10:31:49.999722 run osmo-msc_10.42.42.6(pid=8631): Launched 10:31:50.170940 run osmo-stp_10.42.42.5(pid=8628): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8628)] 10:31:50.299084 run osmo-stp_10.42.42.5(pid=8628): stdout: | (launched: 2022-12-14_10:31:48.806425) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:50.426827 run osmo-stp_10.42.42.5(pid=8628): stderr: | 20221214103148975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103148975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103148975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103148976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103148976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103148976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103148976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:50.552935 run osmo-stp_10.42.42.5(pid=8628): stdout: | (launched: 2022-12-14_10:31:48.806425) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:50.673460 run osmo-stp_10.42.42.5(pid=8628): stderr: | 20221214103148975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103148975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103148975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103148976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103148976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103148976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103148976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:50.817563 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8628): Process ended prematurely: osmo-stp_10.42.42.5(pid=8628) [trial-2403↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8628)] [trial-2403↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 10:31:50.826290 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 10:31:50.852662 run osmo-hlr_10.42.42.2(pid=8625): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8625)] 10:31:50.902026 run osmo-hlr_10.42.42.2(pid=8625): stdout: | (launched: 2022-12-14_10:31:47.869858) 10:31:50.952310 run osmo-hlr_10.42.42.2(pid=8625): stderr: | 20221214103148047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103148047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103148047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103148047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103148047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103148047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103148059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103148068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103148068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103148068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:51.022662 run osmo-msc_10.42.42.6(pid=8631): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8631)] 10:31:51.070504 run osmo-msc_10.42.42.6(pid=8631): stdout: | (launched: 2022-12-14_10:31:49.943805) 10:31:51.120469 run osmo-msc_10.42.42.6(pid=8631): stderr: | 20221214103150217 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103150217 DLGLOBAL DEBUG validating counter group 0x7f624b1abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103150217 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103150217 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103150218 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103150218 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103150221 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103150221 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103150221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103150221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:31:51.170966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8624): Terminating (SIGTERM) 10:31:51.211105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8627): Terminating (SIGTERM) 10:31:51.251921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8630): Terminating (SIGTERM) 10:31:51.292655 --- ParallelTerminationStrategy: PID 8624 died... 10:31:51.312491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8624): Terminated: ok {rc=0} 10:31:51.357170 --- ParallelTerminationStrategy: PID 8627 died... 10:31:51.376262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8627): Terminated: ok {rc=0} 10:31:51.420740 --- ParallelTerminationStrategy: PID 8630 died... 10:31:51.440000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8630): Terminated: ok {rc=0} 10:31:51.527315 bus /sierra_3: Setting Powered False 10:31:52.628294 bus /sierra_3: Setting Powered False 10:31:53.747502 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 10:31:54.837135 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:31:54.848628 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 10:31:54.898818 tst emergency_preemptive_call.py: using LAC 40316 10:31:55.025648 tst emergency_preemptive_call.py: using RAC 26 10:31:55.151766 tst emergency_preemptive_call.py: using CellId 40316 10:31:55.275444 tst emergency_preemptive_call.py: using BVCI 40317 10:31:55.384065 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:31:55.395006 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:31:55.405803 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:31:55.416503 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:31:55.427523 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:31:55.438907 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:31:55.559777 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:31:55.680609 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:31:55.797257 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:31:55.915914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:56.415044 run create_hlr_db(pid=8633): Launched 10:31:56.547504 bus /sierra_2: Setting Powered False 10:31:57.611123 run create_hlr_db(pid=8633): Terminated: ok {rc=0} 10:31:58.044112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8635): Launched 10:31:58.346285 run osmo-hlr_10.42.42.2(pid=8636): Launched 10:31:58.461300 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:58.993133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8638): Launched 10:31:59.295933 run osmo-stp_10.42.42.5(pid=8639): Launched 10:31:59.421615 tst emergency_preemptive_call.py: using MSISDN 8639 10:31:59.584199 run osmo-msc_10.42.42.6: Starting osmo-msc 10:32:00.124034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8641): Launched 10:32:00.424438 run osmo-msc_10.42.42.6(pid=8642): Launched 10:32:00.593336 run osmo-stp_10.42.42.5(pid=8639): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8639)] 10:32:00.721948 run osmo-stp_10.42.42.5(pid=8639): stdout: | (launched: 2022-12-14_10:31:59.240131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:00.873720 run osmo-stp_10.42.42.5(pid=8639): stderr: | 20221214103159409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103159409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103159410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103159410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103159411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103159411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103159411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:01.018341 run osmo-stp_10.42.42.5(pid=8639): stdout: | (launched: 2022-12-14_10:31:59.240131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:01.141978 run osmo-stp_10.42.42.5(pid=8639): stderr: | 20221214103159409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103159409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103159410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103159410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103159411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103159411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103159411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:01.290327 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8639): Process ended prematurely: osmo-stp_10.42.42.5(pid=8639) [trial-2403↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8639)] [trial-2403↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 10:32:01.299916 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 10:32:01.327682 run osmo-hlr_10.42.42.2(pid=8636): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8636)] 10:32:01.379434 run osmo-hlr_10.42.42.2(pid=8636): stdout: | (launched: 2022-12-14_10:31:58.290798) 10:32:01.431789 run osmo-hlr_10.42.42.2(pid=8636): stderr: | 20221214103158465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103158465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103158465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103158465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103158465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103158465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103158478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103158486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103158486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103158486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:01.505389 run osmo-msc_10.42.42.6(pid=8642): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8642)] 10:32:01.555156 run osmo-msc_10.42.42.6(pid=8642): stdout: | (launched: 2022-12-14_10:32:00.368885) 10:32:01.607585 run osmo-msc_10.42.42.6(pid=8642): stderr: | 20221214103200639 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103200639 DLGLOBAL DEBUG validating counter group 0x7f752d1c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103200639 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103200639 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103200639 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103200639 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103200641 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103200642 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103200642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103200642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:32:01.661416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8635): Terminating (SIGTERM) 10:32:01.702963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8638): Terminating (SIGTERM) 10:32:01.745948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8641): Terminating (SIGTERM) 10:32:01.790600 --- ParallelTerminationStrategy: PID 8635 died... 10:32:01.812059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8635): Terminated: ok {rc=0} 10:32:01.860473 --- ParallelTerminationStrategy: PID 8638 died... 10:32:01.881086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8638): Terminated: ok {rc=0} 10:32:01.928033 --- ParallelTerminationStrategy: PID 8641 died... 10:32:01.949368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8641): Terminated: ok {rc=0} 10:32:02.039701 bus /sierra_9: Setting Powered False 10:32:03.139386 bus /sierra_9: Setting Powered False 10:32:04.256681 bus /sierra_8: Setting Powered False 10:32:05.354663 bus /sierra_8: Setting Powered False 10:32:06.470487 bus /sierra_3: Setting Powered False 10:32:07.568290 bus /sierra_3: Setting Powered False 10:32:08.685779 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-umtrx --------------------------------------------------------------------- 10:32:09.968156 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:32:09.972849 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:32:10.006591 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 10:32:10.045808 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 10:32:10.133170 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:32:10.166364 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 10:32:10.205692 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 10:32:10.797905 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 10:32:10.850835 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:10.862097 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:32:10.909704 tst cs_paging_gprs_active.py: using LAC 40317 10:32:11.035731 tst cs_paging_gprs_active.py: using RAC 27 10:32:11.162445 tst cs_paging_gprs_active.py: using CellId 40317 10:32:11.288656 tst cs_paging_gprs_active.py: using BVCI 40318 10:32:11.407261 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:11.418452 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:11.429328 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:11.440151 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:11.450983 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:11.461746 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:11.472748 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:11.483496 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:11.494958 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:32:11.611255 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:32:11.731927 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:32:11.953520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:12.283296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8648): Launched 10:32:12.571601 run iperf3-srv_10.42.42.10(pid=8649): Launched 10:32:12.695064 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:32:12.916251 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:13.245296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8650): Launched 10:32:13.531019 run iperf3-srv_10.42.42.10(pid=8651): Launched 10:32:13.655429 tst cs_paging_gprs_active.py:38: start network... 10:32:13.875590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:14.382968 run create_hlr_db(pid=8652): Launched 10:32:14.517491 bus /sierra_2: Setting Powered False 10:32:15.582381 run create_hlr_db(pid=8652): Terminated: ok {rc=0} 10:32:16.071085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8654): Launched 10:32:16.522560 run osmo-hlr_10.42.42.2(pid=8655): Launched 10:32:16.653302 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:17.493586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8657): Launched 10:32:17.823223 run osmo-stp_10.42.42.5(pid=8658): Launched 10:32:17.949624 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:18.514116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8660): Launched 10:32:18.639269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:18.916312 run patchelf(pid=8661): Launched 10:32:19.099643 run osmo-stp_10.42.42.5(pid=8658): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8658)] 10:32:19.239170 run osmo-stp_10.42.42.5(pid=8658): stdout: | (launched: 2022-12-14_10:32:17.761139) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:19.379676 run osmo-stp_10.42.42.5(pid=8658): stderr: | 20221214103217953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103217954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103217954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103217954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103217955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103217955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103217955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:19.519819 run osmo-stp_10.42.42.5(pid=8658): stdout: | (launched: 2022-12-14_10:32:17.761139) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:19.653527 run osmo-stp_10.42.42.5(pid=8658): stderr: | 20221214103217953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103217954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103217954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103217954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103217955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103217955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103217955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:19.812283 run patchelf(pid=8661): Terminating (SIGINT) 10:32:19.996361 run patchelf(pid=8661): Terminated: ok {rc=0} 10:32:20.128612 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8658): Process ended prematurely: osmo-stp_10.42.42.5(pid=8658) [trial-2403↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8658)] [trial-2403↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 10:32:20.139049 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 10:32:20.167968 run osmo-hlr_10.42.42.2(pid=8655): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8655)] 10:32:20.218037 run osmo-hlr_10.42.42.2(pid=8655): stdout: | (launched: 2022-12-14_10:32:16.441090) 10:32:20.270116 run osmo-hlr_10.42.42.2(pid=8655): stderr: | 20221214103216814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103216814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103216814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103216814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103216814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103216814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103216833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103216860 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103216860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103216860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:20.322623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8648): Terminating (SIGTERM) 10:32:20.364744 run iperf3-srv_10.42.42.10(pid=8649): Terminating (SIGTERM) 10:32:20.407071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8650): Terminating (SIGTERM) 10:32:20.449498 run iperf3-srv_10.42.42.10(pid=8651): Terminating (SIGTERM) 10:32:20.491686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8654): Terminating (SIGTERM) 10:32:20.534132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8657): Terminating (SIGTERM) 10:32:20.576528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8660): Terminating (SIGTERM) 10:32:20.619147 --- ParallelTerminationStrategy: PID 8648 died... 10:32:20.639337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8648): Terminated: ok {rc=0} 10:32:20.685547 --- ParallelTerminationStrategy: PID 8649 died... 10:32:20.705155 run iperf3-srv_10.42.42.10(pid=8649): Terminated {rc=256} 10:32:20.751086 --- ParallelTerminationStrategy: PID 8650 died... 10:32:20.770679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8650): Terminated: ok {rc=0} 10:32:20.817720 --- ParallelTerminationStrategy: PID 8651 died... 10:32:20.837500 run iperf3-srv_10.42.42.10(pid=8651): Terminated {rc=256} 10:32:20.883427 --- ParallelTerminationStrategy: PID 8654 died... 10:32:20.902899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8654): Terminated: ok {rc=0} 10:32:20.948921 --- ParallelTerminationStrategy: PID 8657 died... 10:32:20.968487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8657): Terminated: ok {rc=0} 10:32:21.014433 --- ParallelTerminationStrategy: PID 8660 died... 10:32:21.034170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8660): Terminated: ok {rc=0} 10:32:21.122503 bus /gobi_0: Setting Powered False 10:32:22.222513 bus /gobi_0: Setting Powered False 10:32:23.342499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx iperf3.py ---------------------------------------------- 10:32:24.491011 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:24.502744 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:32:24.554354 tst iperf3.py: using LAC 40318 10:32:24.684268 tst iperf3.py: using RAC 28 10:32:24.813298 tst iperf3.py: using CellId 40318 10:32:24.941405 tst iperf3.py: using BVCI 40319 10:32:25.062172 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:25.073341 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:25.084146 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:25.095283 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:25.106118 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:25.116857 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:25.128210 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:25.139123 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:25.150274 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:32:25.270857 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:32:25.491792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:25.820318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8662): Launched 10:32:26.109707 run iperf3-srv_10.42.42.10(pid=8663): Launched 10:32:26.231986 tst iperf3.py:8: start network... 10:32:26.452701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:26.959286 run create_hlr_db(pid=8664): Launched 10:32:27.094387 bus /gobi_6: Setting Powered False 10:32:28.159568 run create_hlr_db(pid=8664): Terminated: ok {rc=0} 10:32:28.597545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8666): Launched 10:32:28.908688 run osmo-hlr_10.42.42.2(pid=8667): Launched 10:32:29.028098 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:29.556620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8669): Launched 10:32:29.864057 run osmo-stp_10.42.42.5(pid=8670): Launched 10:32:29.981558 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:30.509280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8672): Launched 10:32:30.627670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:30.902415 run patchelf(pid=8673): Launched 10:32:31.105719 run osmo-stp_10.42.42.5(pid=8670): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8670)] 10:32:31.250384 run osmo-stp_10.42.42.5(pid=8670): stdout: | (launched: 2022-12-14_10:32:29.807112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:31.394861 run osmo-stp_10.42.42.5(pid=8670): stderr: | 20221214103229978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103229978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103229978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103229979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103229979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103229979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103229979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:31.541460 run osmo-stp_10.42.42.5(pid=8670): stdout: | (launched: 2022-12-14_10:32:29.807112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:31.671451 run osmo-stp_10.42.42.5(pid=8670): stderr: | 20221214103229978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103229978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103229978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103229979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103229979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103229979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103229979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:31.824298 run patchelf(pid=8673): Terminating (SIGINT) 10:32:32.000596 run patchelf(pid=8673): Terminated: ok {rc=0} 10:32:32.128110 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8670): Process ended prematurely: osmo-stp_10.42.42.5(pid=8670) [trial-2403↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8670)] [trial-2403↪gprs:trx-umtrx↪iperf3.py:8] 10:32:32.138707 tst iperf3.py:8: Test FAILED (7.7 sec) 10:32:32.167117 run osmo-hlr_10.42.42.2(pid=8667): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8667)] 10:32:32.216715 run osmo-hlr_10.42.42.2(pid=8667): stdout: | (launched: 2022-12-14_10:32:28.851500) 10:32:32.268335 run osmo-hlr_10.42.42.2(pid=8667): stderr: | 20221214103229026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103229026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103229027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103229027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103229027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103229027 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103229061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103229070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103229070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103229070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:32.319165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8662): Terminating (SIGTERM) 10:32:32.359672 run iperf3-srv_10.42.42.10(pid=8663): Terminating (SIGTERM) 10:32:32.400083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8666): Terminating (SIGTERM) 10:32:32.440573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8669): Terminating (SIGTERM) 10:32:32.481237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8672): Terminating (SIGTERM) 10:32:32.522489 --- ParallelTerminationStrategy: PID 8662 died... 10:32:32.542403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8662): Terminated: ok {rc=0} 10:32:32.586901 --- ParallelTerminationStrategy: PID 8663 died... 10:32:32.605809 run iperf3-srv_10.42.42.10(pid=8663): Terminated {rc=256} 10:32:32.649998 --- ParallelTerminationStrategy: PID 8666 died... 10:32:32.669302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8666): Terminated: ok {rc=0} 10:32:32.713638 --- ParallelTerminationStrategy: PID 8669 died... 10:32:32.732735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8669): Terminated: ok {rc=0} 10:32:32.777068 --- ParallelTerminationStrategy: PID 8672 died... 10:32:32.796154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8672): Terminated: ok {rc=0} 10:32:32.883215 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 10:32:34.031605 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:34.046111 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:32:34.096312 tst iperf3m4.py: using LAC 40319 10:32:34.216556 tst iperf3m4.py: using RAC 29 10:32:34.334441 tst iperf3m4.py: using CellId 40319 10:32:34.454266 tst iperf3m4.py: using BVCI 40320 10:32:34.567059 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:34.577762 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:34.588157 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:34.598606 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:34.608813 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:34.619381 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:34.630203 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:34.641341 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:34.651930 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:32:34.770279 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:32:34.895329 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:32:35.013244 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:32:35.133696 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:32:35.356718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:35.687540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8675): Launched 10:32:35.977623 run iperf3-srv_10.42.42.10(pid=8676): Launched 10:32:36.103344 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:32:36.325379 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:36.656201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8677): Launched 10:32:36.944507 run iperf3-srv_10.42.42.10(pid=8678): Launched 10:32:37.069440 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:32:37.289477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:37.619232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8679): Launched 10:32:37.907169 run iperf3-srv_10.42.42.10(pid=8680): Launched 10:32:38.031356 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:32:38.252264 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:38.581530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8681): Launched 10:32:38.869121 run iperf3-srv_10.42.42.10(pid=8682): Launched 10:32:38.993696 tst iperf3m4.py:8: start network... 10:32:39.213237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:39.721357 run create_hlr_db(pid=8683): Launched 10:32:39.856101 bus /gobi_6: Setting Powered False 10:32:40.921199 run create_hlr_db(pid=8683): Terminated: ok {rc=0} 10:32:41.379249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8685): Launched 10:32:41.709378 run osmo-hlr_10.42.42.2(pid=8686): Launched 10:32:41.836460 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:42.406624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8688): Launched 10:32:42.736540 run osmo-stp_10.42.42.5(pid=8689): Launched 10:32:42.862092 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:43.427954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8691): Launched 10:32:43.555126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:43.832181 run patchelf(pid=8692): Launched 10:32:44.016324 run osmo-stp_10.42.42.5(pid=8689): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8689)] 10:32:44.154536 run osmo-stp_10.42.42.5(pid=8689): stdout: | (launched: 2022-12-14_10:32:42.675854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:44.294874 run osmo-stp_10.42.42.5(pid=8689): stderr: | 20221214103242867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103242867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103242867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103242868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103242868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103242868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103242868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:44.435049 run osmo-stp_10.42.42.5(pid=8689): stdout: | (launched: 2022-12-14_10:32:42.675854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:44.568804 run osmo-stp_10.42.42.5(pid=8689): stderr: | 20221214103242867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103242867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103242867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103242868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103242868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103242868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103242868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:44.727246 run patchelf(pid=8692): Terminating (SIGINT) 10:32:44.911209 run patchelf(pid=8692): Terminated: ok {rc=0} 10:32:45.044373 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8689): Process ended prematurely: osmo-stp_10.42.42.5(pid=8689) [trial-2403↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8689)] [trial-2403↪gprs:trx-umtrx↪iperf3m4.py:8] 10:32:45.054925 tst iperf3m4.py:8: Test FAILED (11.1 sec) 10:32:45.083956 run osmo-hlr_10.42.42.2(pid=8686): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8686)] 10:32:45.134425 run osmo-hlr_10.42.42.2(pid=8686): stdout: | (launched: 2022-12-14_10:32:41.648378) 10:32:45.186705 run osmo-hlr_10.42.42.2(pid=8686): stderr: | 20221214103241847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103241847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103241847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103241847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103241847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103241847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103241860 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103241870 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103241871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103241871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:45.239374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8675): Terminating (SIGTERM) 10:32:45.281256 run iperf3-srv_10.42.42.10(pid=8676): Terminating (SIGTERM) 10:32:45.323179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8677): Terminating (SIGTERM) 10:32:45.365235 run iperf3-srv_10.42.42.10(pid=8678): Terminating (SIGTERM) 10:32:45.407733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8679): Terminating (SIGTERM) 10:32:45.450106 run iperf3-srv_10.42.42.10(pid=8680): Terminating (SIGTERM) 10:32:45.492360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8681): Terminating (SIGTERM) 10:32:45.534900 run iperf3-srv_10.42.42.10(pid=8682): Terminating (SIGTERM) 10:32:45.576822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8685): Terminating (SIGTERM) 10:32:45.619454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8688): Terminating (SIGTERM) 10:32:45.661445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8691): Terminating (SIGTERM) 10:32:45.703676 --- ParallelTerminationStrategy: PID 8675 died... 10:32:45.723907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8675): Terminated: ok {rc=0} 10:32:45.770621 --- ParallelTerminationStrategy: PID 8676 died... 10:32:45.790423 run iperf3-srv_10.42.42.10(pid=8676): Terminated {rc=256} 10:32:45.838312 --- ParallelTerminationStrategy: PID 8677 died... 10:32:45.860003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8677): Terminated: ok {rc=0} 10:32:45.913417 --- ParallelTerminationStrategy: PID 8678 died... 10:32:45.941598 run iperf3-srv_10.42.42.10(pid=8678): Terminated {rc=256} 10:32:45.992045 --- ParallelTerminationStrategy: PID 8679 died... 10:32:46.013644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8679): Terminated: ok {rc=0} 10:32:46.060939 --- ParallelTerminationStrategy: PID 8680 died... 10:32:46.081429 run iperf3-srv_10.42.42.10(pid=8680): Terminated {rc=256} 10:32:46.128272 --- ParallelTerminationStrategy: PID 8681 died... 10:32:46.148566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8681): Terminated: ok {rc=0} 10:32:46.195446 --- ParallelTerminationStrategy: PID 8682 died... 10:32:46.215891 run iperf3-srv_10.42.42.10(pid=8682): Terminated {rc=256} 10:32:46.262583 --- ParallelTerminationStrategy: PID 8685 died... 10:32:46.283121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8685): Terminated: ok {rc=0} 10:32:46.330214 --- ParallelTerminationStrategy: PID 8688 died... 10:32:46.350307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8688): Terminated: ok {rc=0} 10:32:46.397754 --- ParallelTerminationStrategy: PID 8691 died... 10:32:46.418029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8691): Terminated: ok {rc=0} 10:32:46.507933 bus /gobi_4: Setting Powered False 10:32:47.606120 bus /gobi_4: Setting Powered False 10:32:48.722145 bus /gobi_1: Setting Powered False 10:32:49.820853 bus /gobi_1: Setting Powered False 10:32:50.935885 bus /gobi_0: Setting Powered False 10:32:52.035317 bus /gobi_0: Setting Powered False 10:32:53.151875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx ping.py ---------------------------------------------- 10:32:54.256373 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:54.267715 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:32:54.315602 tst ping.py: using LAC 40320 10:32:54.434511 tst ping.py: using RAC 30 10:32:54.553125 tst ping.py: using CellId 40320 10:32:54.671703 tst ping.py: using BVCI 40321 10:32:54.781988 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:54.792409 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:54.803001 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:54.813380 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:54.823662 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:54.834308 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:54.844930 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:32:54.856283 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:32:54.973324 tst ping.py:19: start network... 10:32:55.176251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:55.643200 run create_hlr_db(pid=8693): Launched 10:32:55.756628 bus /gobi_6: Setting Powered False 10:32:56.816868 run create_hlr_db(pid=8693): Terminated: ok {rc=0} 10:32:57.259504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8695): Launched 10:32:57.582096 run osmo-hlr_10.42.42.2(pid=8696): Launched 10:32:57.704635 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:58.259803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8698): Launched 10:32:58.584233 run osmo-stp_10.42.42.5(pid=8699): Launched 10:32:58.708444 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:59.263878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8701): Launched 10:32:59.388510 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:59.659989 run patchelf(pid=8702): Launched 10:32:59.841751 run osmo-stp_10.42.42.5(pid=8699): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8699)] 10:32:59.978041 run osmo-stp_10.42.42.5(pid=8699): stdout: | (launched: 2022-12-14_10:32:58.522465) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:00.116002 run osmo-stp_10.42.42.5(pid=8699): stderr: | 20221214103258715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103258715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103258715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103258716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103258716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103258716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103258716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:00.254596 run osmo-stp_10.42.42.5(pid=8699): stdout: | (launched: 2022-12-14_10:32:58.522465) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:00.386074 run osmo-stp_10.42.42.5(pid=8699): stderr: | 20221214103258715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103258715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103258715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103258716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103258716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103258716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103258716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:00.542036 run patchelf(pid=8702): Terminating (SIGINT) 10:33:00.722508 run patchelf(pid=8702): Terminated: ok {rc=0} 10:33:00.861889 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8699): Process ended prematurely: osmo-stp_10.42.42.5(pid=8699) [trial-2403↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8699)] [trial-2403↪gprs:trx-umtrx↪ping.py:22] 10:33:00.872636 tst ping.py:22: Test FAILED (6.6 sec) 10:33:00.903412 run osmo-hlr_10.42.42.2(pid=8696): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8696)] 10:33:00.958197 run osmo-hlr_10.42.42.2(pid=8696): stdout: | (launched: 2022-12-14_10:32:57.522741) 10:33:01.011412 run osmo-hlr_10.42.42.2(pid=8696): stderr: | 20221214103257721 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103257721 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103257721 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103257721 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103257721 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103257721 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103257745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103257755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103257755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103257755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:01.065205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8695): Terminating (SIGTERM) 10:33:01.109098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8698): Terminating (SIGTERM) 10:33:01.154485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8701): Terminating (SIGTERM) 10:33:01.200227 --- ParallelTerminationStrategy: PID 8695 died... 10:33:01.222674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8695): Terminated: ok {rc=0} 10:33:01.271292 --- ParallelTerminationStrategy: PID 8698 died... 10:33:01.292320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8698): Terminated: ok {rc=0} 10:33:01.340108 --- ParallelTerminationStrategy: PID 8701 died... 10:33:01.361467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8701): Terminated: ok {rc=0} 10:33:01.452133 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 10:33:02.538357 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:33:02.550009 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:33:02.600915 tst ping_idle_ping.py: using LAC 40321 10:33:02.728801 tst ping_idle_ping.py: using RAC 31 10:33:02.857033 tst ping_idle_ping.py: using CellId 40321 10:33:02.985091 tst ping_idle_ping.py: using BVCI 40322 10:33:03.103717 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:33:03.115419 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:33:03.126648 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:33:03.137977 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:33:03.149341 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:33:03.160740 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:33:03.172353 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:33:03.183849 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:33:03.305142 tst ping_idle_ping.py:24: start network... 10:33:03.523306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:04.026694 run create_hlr_db(pid=8704): Launched 10:33:04.160111 bus /gobi_6: Setting Powered False 10:33:05.225205 run create_hlr_db(pid=8704): Terminated: ok {rc=0} 10:33:05.677945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8706): Launched 10:33:06.001873 run osmo-hlr_10.42.42.2(pid=8707): Launched 10:33:06.125864 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:06.686456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8709): Launched 10:33:07.010942 run osmo-stp_10.42.42.5(pid=8710): Launched 10:33:07.134706 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:33:07.693999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8712): Launched 10:33:07.819211 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:33:08.091155 run patchelf(pid=8713): Launched 10:33:08.271190 run osmo-stp_10.42.42.5(pid=8710): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8710)] 10:33:08.407397 run osmo-stp_10.42.42.5(pid=8710): stdout: | (launched: 2022-12-14_10:33:06.951497) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:08.545556 run osmo-stp_10.42.42.5(pid=8710): stderr: | 20221214103307144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103307144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103307144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103307144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103307145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103307145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103307145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:08.683823 run osmo-stp_10.42.42.5(pid=8710): stdout: | (launched: 2022-12-14_10:33:06.951497) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:08.815763 run osmo-stp_10.42.42.5(pid=8710): stderr: | 20221214103307144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103307144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103307144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103307144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103307145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103307145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103307145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:08.971906 run patchelf(pid=8713): Terminating (SIGINT) 10:33:09.152877 run patchelf(pid=8713): Terminated: ok {rc=0} 10:33:09.284140 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8710): Process ended prematurely: osmo-stp_10.42.42.5(pid=8710) [trial-2403↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8710)] [trial-2403↪gprs:trx-umtrx↪ping_idle_ping.py:27] 10:33:09.294002 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:33:09.322497 run osmo-hlr_10.42.42.2(pid=8707): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8707)] 10:33:09.372805 run osmo-hlr_10.42.42.2(pid=8707): stdout: | (launched: 2022-12-14_10:33:05.942106) 10:33:09.424869 run osmo-hlr_10.42.42.2(pid=8707): stderr: | 20221214103306142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103306142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103306142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103306142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103306142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103306142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103306154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103306162 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103306162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103306162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:09.477448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8706): Terminating (SIGTERM) 10:33:09.519653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8709): Terminating (SIGTERM) 10:33:09.561966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8712): Terminating (SIGTERM) 10:33:09.604551 --- ParallelTerminationStrategy: PID 8706 died... 10:33:09.624842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8706): Terminated: ok {rc=0} 10:33:09.671325 --- ParallelTerminationStrategy: PID 8709 died... 10:33:09.691079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8709): Terminated: ok {rc=0} 10:33:09.737221 --- ParallelTerminationStrategy: PID 8712 died... 10:33:09.756728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8712): Terminated: ok {rc=0} 10:33:09.845968 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 10:33:11.150384 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:33:11.156715 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:33:11.190286 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:33:11.231286 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:33:11.320228 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:33:11.353560 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:33:11.393197 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:33:11.984489 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:33:12.040621 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:12.052158 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:33:12.102222 tst cs_paging_gprs_active.py: using LAC 40322 10:33:12.229894 tst cs_paging_gprs_active.py: using RAC 32 10:33:12.357888 tst cs_paging_gprs_active.py: using CellId 40322 10:33:12.490295 tst cs_paging_gprs_active.py: using BVCI 40323 10:33:12.605740 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:12.616618 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:12.627550 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:12.641548 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:12.653018 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:12.664594 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:12.676320 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:12.687730 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:12.699394 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:33:12.817940 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:33:12.939711 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:33:13.161406 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:13.492128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8717): Launched 10:33:13.781356 run iperf3-srv_10.42.42.10(pid=8718): Launched 10:33:13.907523 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:33:14.129138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:14.459619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8719): Launched 10:33:14.749299 run iperf3-srv_10.42.42.10(pid=8720): Launched 10:33:14.873575 tst cs_paging_gprs_active.py:38: start network... 10:33:15.094615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:15.604205 run create_hlr_db(pid=8721): Launched 10:33:15.738354 bus /gobi_6: Setting Powered False 10:33:16.799203 run create_hlr_db(pid=8721): Terminated: ok {rc=0} 10:33:17.274475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8723): Launched 10:33:17.606360 run osmo-hlr_10.42.42.2(pid=8724): Launched 10:33:17.732336 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:18.300626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8726): Launched 10:33:18.630350 run osmo-stp_10.42.42.5(pid=8727): Launched 10:33:18.755671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:33:19.321651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8729): Launched 10:33:19.447463 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:33:19.724936 run patchelf(pid=8730): Launched 10:33:19.909484 run osmo-stp_10.42.42.5(pid=8727): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8727)] 10:33:20.048887 run osmo-stp_10.42.42.5(pid=8727): stdout: | (launched: 2022-12-14_10:33:18.569852) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:20.190128 run osmo-stp_10.42.42.5(pid=8727): stderr: | 20221214103318762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103318762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103318763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103318763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103318764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103318764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103318764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:20.330543 run osmo-stp_10.42.42.5(pid=8727): stdout: | (launched: 2022-12-14_10:33:18.569852) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:20.464729 run osmo-stp_10.42.42.5(pid=8727): stderr: | 20221214103318762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103318762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103318763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103318763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103318764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103318764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103318764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:20.623978 run patchelf(pid=8730): Terminating (SIGINT) 10:33:20.809246 run patchelf(pid=8730): Terminated: ok {rc=0} 10:33:20.942196 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8727): Process ended prematurely: osmo-stp_10.42.42.5(pid=8727) [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8727)] [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:33:20.952469 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 10:33:20.981625 run osmo-hlr_10.42.42.2(pid=8724): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8724)] 10:33:21.031850 run osmo-hlr_10.42.42.2(pid=8724): stdout: | (launched: 2022-12-14_10:33:17.545668) 10:33:21.084040 run osmo-hlr_10.42.42.2(pid=8724): stderr: | 20221214103317746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103317747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103317747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103317747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103317747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103317747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103317759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103317767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103317768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103317768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:21.136521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8717): Terminating (SIGTERM) 10:33:21.178793 run iperf3-srv_10.42.42.10(pid=8718): Terminating (SIGTERM) 10:33:21.221458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8719): Terminating (SIGTERM) 10:33:21.264060 run iperf3-srv_10.42.42.10(pid=8720): Terminating (SIGTERM) 10:33:21.306816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8723): Terminating (SIGTERM) 10:33:21.349235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8726): Terminating (SIGTERM) 10:33:21.391796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8729): Terminating (SIGTERM) 10:33:21.434658 --- ParallelTerminationStrategy: PID 8717 died... 10:33:21.454987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8717): Terminated: ok {rc=0} 10:33:21.501333 --- ParallelTerminationStrategy: PID 8718 died... 10:33:21.520821 run iperf3-srv_10.42.42.10(pid=8718): Terminated {rc=256} 10:33:21.566776 --- ParallelTerminationStrategy: PID 8719 died... 10:33:21.586477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8719): Terminated: ok {rc=0} 10:33:21.632349 --- ParallelTerminationStrategy: PID 8720 died... 10:33:21.652018 run iperf3-srv_10.42.42.10(pid=8720): Terminated {rc=256} 10:33:21.698051 --- ParallelTerminationStrategy: PID 8723 died... 10:33:21.717795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8723): Terminated: ok {rc=0} 10:33:21.763753 --- ParallelTerminationStrategy: PID 8726 died... 10:33:21.783363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8726): Terminated: ok {rc=0} 10:33:21.829747 --- ParallelTerminationStrategy: PID 8729 died... 10:33:21.849345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8729): Terminated: ok {rc=0} 10:33:21.937254 bus /gobi_0: Setting Powered False 10:33:23.037556 bus /gobi_0: Setting Powered False 10:33:24.154241 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:33:25.304393 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:25.316550 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:33:25.370823 tst iperf3.py: using LAC 40323 10:33:25.501440 tst iperf3.py: using RAC 33 10:33:25.631721 tst iperf3.py: using CellId 40323 10:33:25.762475 tst iperf3.py: using BVCI 40324 10:33:25.883521 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:25.894935 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:25.906098 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:25.917269 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:25.928213 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:25.939414 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:25.950796 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:25.961835 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:25.972905 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:33:26.091882 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:33:26.298325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:26.608114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8731): Launched 10:33:26.877780 run iperf3-srv_10.42.42.10(pid=8732): Launched 10:33:26.993792 tst iperf3.py:8: start network... 10:33:27.199777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:27.677144 run create_hlr_db(pid=8733): Launched 10:33:27.794253 bus /gobi_6: Setting Powered False 10:33:28.855321 run create_hlr_db(pid=8733): Terminated: ok {rc=0} 10:33:29.282750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8735): Launched 10:33:29.591315 run osmo-hlr_10.42.42.2(pid=8736): Launched 10:33:29.710731 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:30.261689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8738): Launched 10:33:30.569999 run osmo-stp_10.42.42.5(pid=8739): Launched 10:33:30.690675 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:33:31.278668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8741): Launched 10:33:31.414414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:33:31.682622 run patchelf(pid=8742): Launched 10:33:31.872877 run osmo-stp_10.42.42.5(pid=8739): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8739)] 10:33:32.055272 run osmo-stp_10.42.42.5(pid=8739): stdout: | (launched: 2022-12-14_10:33:30.512801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:32.193997 run osmo-stp_10.42.42.5(pid=8739): stderr: | 20221214103330684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103330684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103330685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103330685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103330686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103330686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103330686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:32.327874 run osmo-stp_10.42.42.5(pid=8739): stdout: | (launched: 2022-12-14_10:33:30.512801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:32.454250 run osmo-stp_10.42.42.5(pid=8739): stderr: | 20221214103330684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103330684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103330685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103330685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103330686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103330686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103330686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:32.603465 run patchelf(pid=8742): Terminating (SIGINT) 10:33:32.777848 run patchelf(pid=8742): Terminated: ok {rc=0} 10:33:32.903665 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8739): Process ended prematurely: osmo-stp_10.42.42.5(pid=8739) [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8739)] [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 10:33:32.913621 tst iperf3.py:8: Test FAILED (7.6 sec) 10:33:32.941398 run osmo-hlr_10.42.42.2(pid=8736): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8736)] 10:33:32.990012 run osmo-hlr_10.42.42.2(pid=8736): stdout: | (launched: 2022-12-14_10:33:29.534282) 10:33:33.040208 run osmo-hlr_10.42.42.2(pid=8736): stderr: | 20221214103329713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103329713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103329713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103329713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103329713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103329713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103329729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103329738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103329739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103329739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:33.090777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8731): Terminating (SIGTERM) 10:33:33.131119 run iperf3-srv_10.42.42.10(pid=8732): Terminating (SIGTERM) 10:33:33.171309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8735): Terminating (SIGTERM) 10:33:33.211614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8738): Terminating (SIGTERM) 10:33:33.251942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8741): Terminating (SIGTERM) 10:33:33.292699 --- ParallelTerminationStrategy: PID 8731 died... 10:33:33.312794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8731): Terminated: ok {rc=0} 10:33:33.357663 --- ParallelTerminationStrategy: PID 8732 died... 10:33:33.377073 run iperf3-srv_10.42.42.10(pid=8732): Terminated {rc=256} 10:33:33.421715 --- ParallelTerminationStrategy: PID 8735 died... 10:33:33.441033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8735): Terminated: ok {rc=0} 10:33:33.485646 --- ParallelTerminationStrategy: PID 8738 died... 10:33:33.504918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8738): Terminated: ok {rc=0} 10:33:33.549640 --- ParallelTerminationStrategy: PID 8741 died... 10:33:33.568932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8741): Terminated: ok {rc=0} 10:33:33.654127 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:33:34.805953 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:34.818442 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:33:34.870389 tst iperf3m4.py: using LAC 40324 10:33:34.992271 tst iperf3m4.py: using RAC 34 10:33:35.114975 tst iperf3m4.py: using CellId 40324 10:33:35.237568 tst iperf3m4.py: using BVCI 40325 10:33:35.358604 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:35.370445 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:35.381859 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:35.393610 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:35.404749 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:35.416118 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:35.427395 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:35.439944 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:35.453324 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:33:35.577679 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:33:35.698164 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:33:35.819281 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:33:35.941613 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:33:36.163177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:36.493279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8743): Launched 10:33:36.780756 run iperf3-srv_10.42.42.10(pid=8744): Launched 10:33:36.904395 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:33:37.125227 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:37.455831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8745): Launched 10:33:37.745453 run iperf3-srv_10.42.42.10(pid=8746): Launched 10:33:37.868803 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:33:38.089548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:38.419513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8747): Launched 10:33:38.707778 run iperf3-srv_10.42.42.10(pid=8748): Launched 10:33:38.832719 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:33:39.053368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:33:39.383740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8749): Launched 10:33:39.672933 run iperf3-srv_10.42.42.10(pid=8750): Launched 10:33:39.797455 tst iperf3m4.py:8: start network... 10:33:40.018964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:40.527083 run create_hlr_db(pid=8751): Launched 10:33:40.661917 bus /gobi_6: Setting Powered False 10:33:41.726376 run create_hlr_db(pid=8751): Terminated: ok {rc=0} 10:33:42.166574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8753): Launched 10:33:42.476535 run osmo-hlr_10.42.42.2(pid=8754): Launched 10:33:42.595431 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:43.129100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8756): Launched 10:33:43.438491 run osmo-stp_10.42.42.5(pid=8757): Launched 10:33:43.557380 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:33:44.090016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8759): Launched 10:33:44.210083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:33:44.471614 run patchelf(pid=8760): Launched 10:33:44.644870 run osmo-stp_10.42.42.5(pid=8757): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8757)] 10:33:44.775354 run osmo-stp_10.42.42.5(pid=8757): stdout: | (launched: 2022-12-14_10:33:43.380849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:44.907568 run osmo-stp_10.42.42.5(pid=8757): stderr: | 20221214103343547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103343547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103343547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103343548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103343548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103343548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103343548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:45.039939 run osmo-stp_10.42.42.5(pid=8757): stdout: | (launched: 2022-12-14_10:33:43.380849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:45.166135 run osmo-stp_10.42.42.5(pid=8757): stderr: | 20221214103343547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103343547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103343547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103343548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103343548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103343548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103343548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:45.315943 run patchelf(pid=8760): Terminating (SIGINT) 10:33:45.490276 run patchelf(pid=8760): Terminated: ok {rc=0} 10:33:45.615750 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8757): Process ended prematurely: osmo-stp_10.42.42.5(pid=8757) [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8757)] [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 10:33:45.625557 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:33:45.653368 run osmo-hlr_10.42.42.2(pid=8754): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8754)] 10:33:45.702000 run osmo-hlr_10.42.42.2(pid=8754): stdout: | (launched: 2022-12-14_10:33:42.419778) 10:33:45.752185 run osmo-hlr_10.42.42.2(pid=8754): stderr: | 20221214103342593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103342593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103342593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103342593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103342593 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103342593 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103342606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103342614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103342615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103342615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:45.802804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8743): Terminating (SIGTERM) 10:33:45.846764 run iperf3-srv_10.42.42.10(pid=8744): Terminating (SIGTERM) 10:33:45.899578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8745): Terminating (SIGTERM) 10:33:45.951707 run iperf3-srv_10.42.42.10(pid=8746): Terminating (SIGTERM) 10:33:45.995793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8747): Terminating (SIGTERM) 10:33:46.037993 run iperf3-srv_10.42.42.10(pid=8748): Terminating (SIGTERM) 10:33:46.085862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8749): Terminating (SIGTERM) 10:33:46.127909 run iperf3-srv_10.42.42.10(pid=8750): Terminating (SIGTERM) 10:33:46.172366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8753): Terminating (SIGTERM) 10:33:46.214035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8756): Terminating (SIGTERM) 10:33:46.255052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8759): Terminating (SIGTERM) 10:33:46.296300 --- ParallelTerminationStrategy: PID 8743 died... 10:33:46.316136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8743): Terminated: ok {rc=0} 10:33:46.361659 --- ParallelTerminationStrategy: PID 8744 died... 10:33:46.381335 run iperf3-srv_10.42.42.10(pid=8744): Terminated {rc=256} 10:33:46.426549 --- ParallelTerminationStrategy: PID 8745 died... 10:33:46.446370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8745): Terminated: ok {rc=0} 10:33:46.492058 --- ParallelTerminationStrategy: PID 8746 died... 10:33:46.511801 run iperf3-srv_10.42.42.10(pid=8746): Terminated {rc=256} 10:33:46.557742 --- ParallelTerminationStrategy: PID 8747 died... 10:33:46.577455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8747): Terminated: ok {rc=0} 10:33:46.623129 --- ParallelTerminationStrategy: PID 8748 died... 10:33:46.642988 run iperf3-srv_10.42.42.10(pid=8748): Terminated {rc=256} 10:33:46.688404 --- ParallelTerminationStrategy: PID 8749 died... 10:33:46.708259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8749): Terminated: ok {rc=0} 10:33:46.753888 --- ParallelTerminationStrategy: PID 8750 died... 10:33:46.773763 run iperf3-srv_10.42.42.10(pid=8750): Terminated {rc=256} 10:33:46.818998 --- ParallelTerminationStrategy: PID 8753 died... 10:33:46.838912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8753): Terminated: ok {rc=0} 10:33:46.884479 --- ParallelTerminationStrategy: PID 8756 died... 10:33:46.904445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8756): Terminated: ok {rc=0} 10:33:46.950101 --- ParallelTerminationStrategy: PID 8759 died... 10:33:46.970102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8759): Terminated: ok {rc=0} 10:33:47.057547 bus /gobi_4: Setting Powered False 10:33:48.153993 bus /gobi_4: Setting Powered False 10:33:49.271465 bus /gobi_1: Setting Powered False 10:33:50.371211 bus /gobi_1: Setting Powered False 10:33:51.486879 bus /gobi_0: Setting Powered False 10:33:52.586463 bus /gobi_0: Setting Powered False 10:33:53.703051 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 10:33:54.806638 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:54.818181 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:33:54.869360 tst ping.py: using LAC 40325 10:33:54.997630 tst ping.py: using RAC 35 10:33:55.124923 tst ping.py: using CellId 40325 10:33:55.253532 tst ping.py: using BVCI 40326 10:33:55.365490 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:55.376469 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:55.387333 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:55.398017 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:55.409197 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:55.420230 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:55.431356 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:33:55.442306 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:33:55.562864 tst ping.py:19: start network... 10:33:55.781401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:56.281367 run create_hlr_db(pid=8761): Launched 10:33:56.413731 bus /gobi_6: Setting Powered False 10:33:57.478200 run create_hlr_db(pid=8761): Terminated: ok {rc=0} 10:33:57.911944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8763): Launched 10:33:58.237047 run osmo-hlr_10.42.42.2(pid=8764): Launched 10:33:58.361123 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:58.922233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8766): Launched 10:33:59.244664 run osmo-stp_10.42.42.5(pid=8767): Launched 10:33:59.368276 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:33:59.930287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8769): Launched 10:34:00.055709 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:34:00.328429 run patchelf(pid=8770): Launched 10:34:00.509078 run osmo-stp_10.42.42.5(pid=8767): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8767)] 10:34:00.644825 run osmo-stp_10.42.42.5(pid=8767): stdout: | (launched: 2022-12-14_10:33:59.184457) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:00.783191 run osmo-stp_10.42.42.5(pid=8767): stderr: | 20221214103359376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103359376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103359376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103359377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103359377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103359377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103359377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:00.945327 run osmo-stp_10.42.42.5(pid=8767): stdout: | (launched: 2022-12-14_10:33:59.184457) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:01.079302 run osmo-stp_10.42.42.5(pid=8767): stderr: | 20221214103359376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103359376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103359376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103359377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103359377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103359377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103359377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:01.235009 run patchelf(pid=8770): Terminating (SIGINT) 10:34:01.414184 run patchelf(pid=8770): Terminated: ok {rc=0} 10:34:01.545491 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8767): Process ended prematurely: osmo-stp_10.42.42.5(pid=8767) [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8767)] [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 10:34:01.555956 tst ping.py:22: Test FAILED (6.7 sec) 10:34:01.585616 run osmo-hlr_10.42.42.2(pid=8764): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8764)] 10:34:01.639745 run osmo-hlr_10.42.42.2(pid=8764): stdout: | (launched: 2022-12-14_10:33:58.177672) 10:34:01.695119 run osmo-hlr_10.42.42.2(pid=8764): stderr: | 20221214103358376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103358376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103358376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103358376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103358376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103358376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103358389 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103358397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103358397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103358397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:01.749409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8763): Terminating (SIGTERM) 10:34:01.792383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8766): Terminating (SIGTERM) 10:34:01.839275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8769): Terminating (SIGTERM) 10:34:01.885967 --- ParallelTerminationStrategy: PID 8763 died... 10:34:01.908718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8763): Terminated: ok {rc=0} 10:34:01.958055 --- ParallelTerminationStrategy: PID 8766 died... 10:34:01.979396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8766): Terminated: ok {rc=0} 10:34:02.026046 --- ParallelTerminationStrategy: PID 8769 died... 10:34:02.047651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8769): Terminated: ok {rc=0} 10:34:02.149118 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:34:03.236845 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:34:03.249082 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:34:03.302783 tst ping_idle_ping.py: using LAC 40326 10:34:03.434467 tst ping_idle_ping.py: using RAC 36 10:34:03.561261 tst ping_idle_ping.py: using CellId 40326 10:34:03.686506 tst ping_idle_ping.py: using BVCI 40327 10:34:03.803361 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:34:03.815012 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:34:03.826778 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:34:03.838049 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:34:03.849250 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:34:03.860383 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:34:03.871806 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:34:03.883123 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:34:04.004891 tst ping_idle_ping.py:24: start network... 10:34:04.223044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:04.725035 run create_hlr_db(pid=8772): Launched 10:34:04.856218 bus /gobi_6: Setting Powered False 10:34:05.921312 run create_hlr_db(pid=8772): Terminated: ok {rc=0} 10:34:06.373974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8774): Launched 10:34:06.698744 run osmo-hlr_10.42.42.2(pid=8775): Launched 10:34:06.823272 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:07.379550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8777): Launched 10:34:07.705197 run osmo-stp_10.42.42.5(pid=8778): Launched 10:34:07.830522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:34:08.387936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8780): Launched 10:34:08.513423 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:34:08.786588 run patchelf(pid=8781): Launched 10:34:08.967468 run osmo-stp_10.42.42.5(pid=8778): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8778)] 10:34:09.104353 run osmo-stp_10.42.42.5(pid=8778): stdout: | (launched: 2022-12-14_10:34:07.645393) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:09.242814 run osmo-stp_10.42.42.5(pid=8778): stderr: | 20221214103407838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103407838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103407838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103407839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103407839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103407839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103407839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:09.381870 run osmo-stp_10.42.42.5(pid=8778): stdout: | (launched: 2022-12-14_10:34:07.645393) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:09.513836 run osmo-stp_10.42.42.5(pid=8778): stderr: | 20221214103407838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103407838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103407838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103407839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103407839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103407839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103407839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:09.671317 run patchelf(pid=8781): Terminating (SIGINT) 10:34:09.853568 run patchelf(pid=8781): Terminated: ok {rc=0} 10:34:09.984587 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8778): Process ended prematurely: osmo-stp_10.42.42.5(pid=8778) [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8778)] [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 10:34:09.994366 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:34:10.022928 run osmo-hlr_10.42.42.2(pid=8775): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8775)] 10:34:10.073533 run osmo-hlr_10.42.42.2(pid=8775): stdout: | (launched: 2022-12-14_10:34:06.639004) 10:34:10.125872 run osmo-hlr_10.42.42.2(pid=8775): stderr: | 20221214103406837 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103406837 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103406837 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103406837 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103406838 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103406838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103406850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103406858 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103406858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103406858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:10.178650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8774): Terminating (SIGTERM) 10:34:10.220793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8777): Terminating (SIGTERM) 10:34:10.263025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8780): Terminating (SIGTERM) 10:34:10.305431 --- ParallelTerminationStrategy: PID 8774 died... 10:34:10.326048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8774): Terminated: ok {rc=0} 10:34:10.372627 --- ParallelTerminationStrategy: PID 8777 died... 10:34:10.392440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8777): Terminated: ok {rc=0} 10:34:10.438734 --- ParallelTerminationStrategy: PID 8780 died... 10:34:10.458766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8780): Terminated: ok {rc=0} 10:34:10.547402 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:34:11.845496 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:34:11.851676 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:34:11.884000 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:34:11.922872 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:34:12.010009 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:34:12.042007 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:34:12.080177 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:34:12.671991 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:34:12.722005 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:12.732779 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:34:12.801106 tst cs_paging_gprs_active.py: using LAC 40327 10:34:12.923261 tst cs_paging_gprs_active.py: using RAC 37 10:34:13.045850 tst cs_paging_gprs_active.py: using CellId 40327 10:34:13.166636 tst cs_paging_gprs_active.py: using BVCI 40328 10:34:13.280007 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:13.290865 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:13.301612 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:13.312262 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:13.323234 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:13.334852 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:13.345911 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:13.356745 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:13.367893 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:34:13.485821 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:34:13.607167 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:34:13.831347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:14.163379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8785): Launched 10:34:14.452283 run iperf3-srv_10.42.42.10(pid=8786): Launched 10:34:14.577935 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:34:14.799055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:15.130870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8787): Launched 10:34:15.418390 run iperf3-srv_10.42.42.10(pid=8788): Launched 10:34:15.542163 tst cs_paging_gprs_active.py:38: start network... 10:34:15.764779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:16.370719 run create_hlr_db(pid=8789): Launched 10:34:16.543947 bus /gobi_6: Setting Powered False 10:34:17.609557 run create_hlr_db(pid=8789): Terminated: ok {rc=0} 10:34:18.052030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8791): Launched 10:34:18.362152 run osmo-hlr_10.42.42.2(pid=8792): Launched 10:34:18.479248 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:19.012040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8794): Launched 10:34:19.324326 run osmo-stp_10.42.42.5(pid=8795): Launched 10:34:19.443946 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:34:19.974802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8797): Launched 10:34:20.095329 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:34:20.364138 run patchelf(pid=8798): Launched 10:34:20.537762 run osmo-stp_10.42.42.5(pid=8795): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8795)] 10:34:20.669775 run osmo-stp_10.42.42.5(pid=8795): stdout: | (launched: 2022-12-14_10:34:19.266443) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:20.802585 run osmo-stp_10.42.42.5(pid=8795): stderr: | 20221214103419437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103419437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103419437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103419438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103419438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103419438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103419439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:20.935587 run osmo-stp_10.42.42.5(pid=8795): stdout: | (launched: 2022-12-14_10:34:19.266443) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:21.062350 run osmo-stp_10.42.42.5(pid=8795): stderr: | 20221214103419437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103419437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103419437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103419438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103419438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103419438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103419439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:21.212609 run patchelf(pid=8798): Terminating (SIGINT) 10:34:21.387033 run patchelf(pid=8798): Terminated: ok {rc=0} 10:34:21.512897 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8795): Process ended prematurely: osmo-stp_10.42.42.5(pid=8795) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8795)] [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:34:21.522727 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:34:21.550308 run osmo-hlr_10.42.42.2(pid=8792): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8792)] 10:34:21.599055 run osmo-hlr_10.42.42.2(pid=8792): stdout: | (launched: 2022-12-14_10:34:18.304813) 10:34:21.649450 run osmo-hlr_10.42.42.2(pid=8792): stderr: | 20221214103418481 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103418481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103418481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103418481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103418481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103418481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103418492 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103418500 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103418501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103418501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:21.700018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8785): Terminating (SIGTERM) 10:34:21.740666 run iperf3-srv_10.42.42.10(pid=8786): Terminating (SIGTERM) 10:34:21.781334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8787): Terminating (SIGTERM) 10:34:21.821664 run iperf3-srv_10.42.42.10(pid=8788): Terminating (SIGTERM) 10:34:21.861844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8791): Terminating (SIGTERM) 10:34:21.902040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8794): Terminating (SIGTERM) 10:34:21.942225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8797): Terminating (SIGTERM) 10:34:21.982687 --- ParallelTerminationStrategy: PID 8785 died... 10:34:22.002486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8785): Terminated: ok {rc=0} 10:34:22.047157 --- ParallelTerminationStrategy: PID 8786 died... 10:34:22.066195 run iperf3-srv_10.42.42.10(pid=8786): Terminated {rc=256} 10:34:22.110799 --- ParallelTerminationStrategy: PID 8787 died... 10:34:22.130067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8787): Terminated: ok {rc=0} 10:34:22.174615 --- ParallelTerminationStrategy: PID 8788 died... 10:34:22.193727 run iperf3-srv_10.42.42.10(pid=8788): Terminated {rc=256} 10:34:22.238081 --- ParallelTerminationStrategy: PID 8791 died... 10:34:22.257291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8791): Terminated: ok {rc=0} 10:34:22.301655 --- ParallelTerminationStrategy: PID 8794 died... 10:34:22.320864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8794): Terminated: ok {rc=0} 10:34:22.365291 --- ParallelTerminationStrategy: PID 8797 died... 10:34:22.384264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8797): Terminated: ok {rc=0} 10:34:22.469367 bus /gobi_0: Setting Powered False 10:34:23.566276 bus /gobi_0: Setting Powered False 10:34:24.682849 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:34:25.830695 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:25.842455 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:34:25.911754 tst iperf3.py: using LAC 40328 10:34:26.031717 tst iperf3.py: using RAC 38 10:34:26.154072 tst iperf3.py: using CellId 40328 10:34:26.273360 tst iperf3.py: using BVCI 40329 10:34:26.384833 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:26.395723 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:26.406564 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:26.417329 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:26.428092 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:26.439791 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:26.451044 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:26.462192 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:26.473528 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:34:26.595766 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:34:26.818665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:27.150088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8799): Launched 10:34:27.436704 run iperf3-srv_10.42.42.10(pid=8800): Launched 10:34:27.561873 tst iperf3.py:8: start network... 10:34:27.782942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:28.292290 run create_hlr_db(pid=8801): Launched 10:34:28.428363 bus /gobi_6: Setting Powered False 10:34:29.493954 run create_hlr_db(pid=8801): Terminated: ok {rc=0} 10:34:29.934175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8803): Launched 10:34:30.243214 run osmo-hlr_10.42.42.2(pid=8804): Launched 10:34:30.361084 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:31.031012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8806): Launched 10:34:31.354765 run osmo-stp_10.42.42.5(pid=8807): Launched 10:34:31.590977 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:34:32.233800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8809): Launched 10:34:32.356172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:34:32.612624 run patchelf(pid=8810): Launched 10:34:32.782115 run osmo-stp_10.42.42.5(pid=8807): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8807)] 10:34:32.910537 run osmo-stp_10.42.42.5(pid=8807): stdout: | (launched: 2022-12-14_10:34:31.293757) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:33.040292 run osmo-stp_10.42.42.5(pid=8807): stderr: | 20221214103431627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103431627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103431628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103431628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103431634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103431635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103431635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:33.170558 run osmo-stp_10.42.42.5(pid=8807): stdout: | (launched: 2022-12-14_10:34:31.293757) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:33.294643 run osmo-stp_10.42.42.5(pid=8807): stderr: | 20221214103431627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103431627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103431628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103431628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103431634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103431635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103431635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:33.442050 run patchelf(pid=8810): Terminating (SIGINT) 10:34:33.612849 run patchelf(pid=8810): Terminated: ok {rc=0} 10:34:33.737340 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8807): Process ended prematurely: osmo-stp_10.42.42.5(pid=8807) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8807)] [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 10:34:33.747160 tst iperf3.py:8: Test FAILED (8.0 sec) 10:34:33.774759 run osmo-hlr_10.42.42.2(pid=8804): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8804)] 10:34:33.823435 run osmo-hlr_10.42.42.2(pid=8804): stdout: | (launched: 2022-12-14_10:34:30.186063) 10:34:33.873867 run osmo-hlr_10.42.42.2(pid=8804): stderr: | 20221214103430362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103430362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103430362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103430362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103430362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103430362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103430375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103430385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103430386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103430386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:33.924323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8799): Terminating (SIGTERM) 10:34:33.964773 run iperf3-srv_10.42.42.10(pid=8800): Terminating (SIGTERM) 10:34:34.005176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8803): Terminating (SIGTERM) 10:34:34.045616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8806): Terminating (SIGTERM) 10:34:34.086437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8809): Terminating (SIGTERM) 10:34:34.127447 --- ParallelTerminationStrategy: PID 8799 died... 10:34:34.147198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8799): Terminated: ok {rc=0} 10:34:34.191988 --- ParallelTerminationStrategy: PID 8800 died... 10:34:34.211180 run iperf3-srv_10.42.42.10(pid=8800): Terminated {rc=256} 10:34:34.255979 --- ParallelTerminationStrategy: PID 8803 died... 10:34:34.275436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8803): Terminated: ok {rc=0} 10:34:34.319680 --- ParallelTerminationStrategy: PID 8806 died... 10:34:34.338855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8806): Terminated: ok {rc=0} 10:34:34.383150 --- ParallelTerminationStrategy: PID 8809 died... 10:34:34.402407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8809): Terminated: ok {rc=0} 10:34:34.490074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:34:35.637021 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:35.649056 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:34:35.717827 tst iperf3m4.py: using LAC 40329 10:34:35.835808 tst iperf3m4.py: using RAC 39 10:34:35.957656 tst iperf3m4.py: using CellId 40329 10:34:36.084321 tst iperf3m4.py: using BVCI 40330 10:34:36.200169 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:36.211535 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:36.222714 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:36.233866 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:36.244824 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:36.256252 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:36.267607 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:36.278637 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:36.289905 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:34:36.408941 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:34:36.527899 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:34:36.647416 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:34:36.766625 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:34:36.982052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:37.303448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8811): Launched 10:34:37.583061 run iperf3-srv_10.42.42.10(pid=8812): Launched 10:34:37.704608 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:34:37.920085 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:38.241849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8813): Launched 10:34:38.505643 run iperf3-srv_10.42.42.10(pid=8814): Launched 10:34:38.618662 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:34:38.819245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:39.122206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8815): Launched 10:34:39.384606 run iperf3-srv_10.42.42.10(pid=8816): Launched 10:34:39.497131 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:34:39.696795 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:34:39.999853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8817): Launched 10:34:40.262650 run iperf3-srv_10.42.42.10(pid=8818): Launched 10:34:40.375146 tst iperf3m4.py:8: start network... 10:34:40.574997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:41.043030 run create_hlr_db(pid=8819): Launched 10:34:41.159168 bus /gobi_6: Setting Powered False 10:34:42.218459 run create_hlr_db(pid=8819): Terminated: ok {rc=0} 10:34:42.657064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8821): Launched 10:34:42.978546 run osmo-hlr_10.42.42.2(pid=8822): Launched 10:34:43.101101 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:43.653950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8824): Launched 10:34:43.976628 run osmo-stp_10.42.42.5(pid=8825): Launched 10:34:44.098904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:34:44.651001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8827): Launched 10:34:44.773576 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:34:45.045729 run patchelf(pid=8828): Launched 10:34:45.224589 run osmo-stp_10.42.42.5(pid=8825): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8825)] 10:34:45.360306 run osmo-stp_10.42.42.5(pid=8825): stdout: | (launched: 2022-12-14_10:34:43.917404) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:45.497453 run osmo-stp_10.42.42.5(pid=8825): stderr: | 20221214103444106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103444106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103444107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103444107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103444107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103444107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103444108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:45.634157 run osmo-stp_10.42.42.5(pid=8825): stdout: | (launched: 2022-12-14_10:34:43.917404) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:45.764885 run osmo-stp_10.42.42.5(pid=8825): stderr: | 20221214103444106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103444106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103444107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103444107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103444107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103444107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103444108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:45.943350 run patchelf(pid=8828): Terminating (SIGINT) 10:34:46.147754 run patchelf(pid=8828): Terminated: ok {rc=0} 10:34:46.277706 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8825): Process ended prematurely: osmo-stp_10.42.42.5(pid=8825) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8825)] [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:34:46.288464 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:34:46.317932 run osmo-hlr_10.42.42.2(pid=8822): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8822)] 10:34:46.370090 run osmo-hlr_10.42.42.2(pid=8822): stdout: | (launched: 2022-12-14_10:34:42.919080) 10:34:46.422604 run osmo-hlr_10.42.42.2(pid=8822): stderr: | 20221214103443116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103443116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103443116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103443116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103443116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103443117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103443129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103443139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103443139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103443139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:46.477813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8811): Terminating (SIGTERM) 10:34:46.520052 run iperf3-srv_10.42.42.10(pid=8812): Terminating (SIGTERM) 10:34:46.566494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8813): Terminating (SIGTERM) 10:34:46.610622 run iperf3-srv_10.42.42.10(pid=8814): Terminating (SIGTERM) 10:34:46.656163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8815): Terminating (SIGTERM) 10:34:46.699770 run iperf3-srv_10.42.42.10(pid=8816): Terminating (SIGTERM) 10:34:46.743700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8817): Terminating (SIGTERM) 10:34:46.786501 run iperf3-srv_10.42.42.10(pid=8818): Terminating (SIGTERM) 10:34:46.828792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8821): Terminating (SIGTERM) 10:34:46.872810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8824): Terminating (SIGTERM) 10:34:46.918022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8827): Terminating (SIGTERM) 10:34:46.964483 --- ParallelTerminationStrategy: PID 8811 died... 10:34:46.985979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8811): Terminated: ok {rc=0} 10:34:47.034194 --- ParallelTerminationStrategy: PID 8812 died... 10:34:47.055799 run iperf3-srv_10.42.42.10(pid=8812): Terminated {rc=256} 10:34:47.102291 --- ParallelTerminationStrategy: PID 8813 died... 10:34:47.123150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8813): Terminated: ok {rc=0} 10:34:47.169724 --- ParallelTerminationStrategy: PID 8814 died... 10:34:47.191386 run iperf3-srv_10.42.42.10(pid=8814): Terminated {rc=256} 10:34:47.239643 --- ParallelTerminationStrategy: PID 8815 died... 10:34:47.260753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8815): Terminated: ok {rc=0} 10:34:47.307567 --- ParallelTerminationStrategy: PID 8816 died... 10:34:47.328516 run iperf3-srv_10.42.42.10(pid=8816): Terminated {rc=256} 10:34:47.375486 --- ParallelTerminationStrategy: PID 8817 died... 10:34:47.397069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8817): Terminated: ok {rc=0} 10:34:47.441665 --- ParallelTerminationStrategy: PID 8818 died... 10:34:47.460747 run iperf3-srv_10.42.42.10(pid=8818): Terminated {rc=256} 10:34:47.505255 --- ParallelTerminationStrategy: PID 8821 died... 10:34:47.524683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8821): Terminated: ok {rc=0} 10:34:47.568854 --- ParallelTerminationStrategy: PID 8824 died... 10:34:47.588343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8824): Terminated: ok {rc=0} 10:34:47.633045 --- ParallelTerminationStrategy: PID 8827 died... 10:34:47.652445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8827): Terminated: ok {rc=0} 10:34:47.740123 bus /gobi_4: Setting Powered False 10:34:48.840723 bus /gobi_4: Setting Powered False 10:34:49.956625 bus /gobi_1: Setting Powered False 10:34:51.057243 bus /gobi_1: Setting Powered False 10:34:52.174627 bus /gobi_0: Setting Powered False 10:34:53.274877 bus /gobi_0: Setting Powered False 10:34:54.394028 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:34:55.497880 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:55.510025 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:34:55.580774 tst ping.py: using LAC 40330 10:34:55.697878 tst ping.py: using RAC 40 10:34:55.816521 tst ping.py: using CellId 40330 10:34:55.933372 tst ping.py: using BVCI 40331 10:34:56.043639 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:56.054864 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:56.065703 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:56.076324 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:56.087490 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:56.098532 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:56.109762 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:34:56.120783 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:34:56.239937 tst ping.py:19: start network... 10:34:56.438889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:56.902299 run create_hlr_db(pid=8829): Launched 10:34:57.017437 bus /gobi_6: Setting Powered False 10:34:58.078190 run create_hlr_db(pid=8829): Terminated: ok {rc=0} 10:34:58.514066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8831): Launched 10:34:58.816188 run osmo-hlr_10.42.42.2(pid=8832): Launched 10:34:58.930599 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:59.459246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8834): Launched 10:34:59.757049 run osmo-stp_10.42.42.5(pid=8835): Launched 10:34:59.870074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:35:00.383255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8837): Launched 10:35:00.497580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:35:00.749695 run patchelf(pid=8838): Launched 10:35:00.917485 run osmo-stp_10.42.42.5(pid=8835): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8835)] 10:35:01.046814 run osmo-stp_10.42.42.5(pid=8835): stdout: | (launched: 2022-12-14_10:34:59.701930) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:01.178980 run osmo-stp_10.42.42.5(pid=8835): stderr: | 20221214103459871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103459871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103459871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103459872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103459872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103459872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103459872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:01.311600 run osmo-stp_10.42.42.5(pid=8835): stdout: | (launched: 2022-12-14_10:34:59.701930) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:01.464315 run osmo-stp_10.42.42.5(pid=8835): stderr: | 20221214103459871 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103459871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103459871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103459872 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103459872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103459872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103459872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:01.669328 run patchelf(pid=8838): Terminating (SIGINT) 10:35:01.850571 run patchelf(pid=8838): Terminated: ok {rc=0} 10:35:01.975034 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8835): Process ended prematurely: osmo-stp_10.42.42.5(pid=8835) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8835)] [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 10:35:01.985272 tst ping.py:22: Test FAILED (6.5 sec) 10:35:02.013518 run osmo-hlr_10.42.42.2(pid=8832): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8832)] 10:35:02.064436 run osmo-hlr_10.42.42.2(pid=8832): stdout: | (launched: 2022-12-14_10:34:58.760727) 10:35:02.118789 run osmo-hlr_10.42.42.2(pid=8832): stderr: | 20221214103458938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103458938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103458938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103458938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103458938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103458938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103458950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103458958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103458959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103458959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:02.171389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8831): Terminating (SIGTERM) 10:35:02.214951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8834): Terminating (SIGTERM) 10:35:02.259228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8837): Terminating (SIGTERM) 10:35:02.302703 --- ParallelTerminationStrategy: PID 8831 died... 10:35:02.324326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8831): Terminated: ok {rc=0} 10:35:02.370180 --- ParallelTerminationStrategy: PID 8834 died... 10:35:02.389908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8834): Terminated: ok {rc=0} 10:35:02.435238 --- ParallelTerminationStrategy: PID 8837 died... 10:35:02.455218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8837): Terminated: ok {rc=0} 10:35:02.543979 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:35:03.633400 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:35:03.644927 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:35:03.718421 tst ping_idle_ping.py: using LAC 40331 10:35:03.845901 tst ping_idle_ping.py: using RAC 41 10:35:03.970585 tst ping_idle_ping.py: using CellId 40331 10:35:04.094465 tst ping_idle_ping.py: using BVCI 40332 10:35:04.209156 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:35:04.221151 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:35:04.232624 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:35:04.243881 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:35:04.255189 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:35:04.266674 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:35:04.278310 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:35:04.289771 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:35:04.406044 tst ping_idle_ping.py:24: start network... 10:35:04.605103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:05.066021 run create_hlr_db(pid=8842): Launched 10:35:05.199373 bus /gobi_6: Setting Powered False 10:35:06.263480 run create_hlr_db(pid=8842): Terminated: ok {rc=0} 10:35:06.707386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8845): Launched 10:35:07.026264 run osmo-hlr_10.42.42.2(pid=8846): Launched 10:35:07.146398 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:07.689147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8848): Launched 10:35:08.007957 run osmo-stp_10.42.42.5(pid=8849): Launched 10:35:08.129060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:35:08.674607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8851): Launched 10:35:08.797464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:35:09.065959 run patchelf(pid=8852): Launched 10:35:09.243686 run osmo-stp_10.42.42.5(pid=8849): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8849)] 10:35:09.378656 run osmo-stp_10.42.42.5(pid=8849): stdout: | (launched: 2022-12-14_10:35:07.949329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:09.515496 run osmo-stp_10.42.42.5(pid=8849): stderr: | 20221214103508141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103508141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103508141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103508142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103508142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103508142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103508142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:09.652453 run osmo-stp_10.42.42.5(pid=8849): stdout: | (launched: 2022-12-14_10:35:07.949329) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:09.783178 run osmo-stp_10.42.42.5(pid=8849): stderr: | 20221214103508141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103508141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103508141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103508142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103508142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103508142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103508142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:09.938379 run patchelf(pid=8852): Terminating (SIGINT) 10:35:10.117084 run patchelf(pid=8852): Terminated: ok {rc=0} 10:35:10.246373 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8849): Process ended prematurely: osmo-stp_10.42.42.5(pid=8849) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8849)] [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:35:10.256480 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:35:10.285086 run osmo-hlr_10.42.42.2(pid=8846): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8846)] 10:35:10.335932 run osmo-hlr_10.42.42.2(pid=8846): stdout: | (launched: 2022-12-14_10:35:06.967586) 10:35:10.388659 run osmo-hlr_10.42.42.2(pid=8846): stderr: | 20221214103507164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103507165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103507165 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103507165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103507165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103507165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103507187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103507197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103507197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103507197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:10.441503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8845): Terminating (SIGTERM) 10:35:10.483811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8848): Terminating (SIGTERM) 10:35:10.526136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8851): Terminating (SIGTERM) 10:35:10.568659 --- ParallelTerminationStrategy: PID 8845 died... 10:35:10.589204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8845): Terminated: ok {rc=0} 10:35:10.636102 --- ParallelTerminationStrategy: PID 8848 died... 10:35:10.656063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8848): Terminated: ok {rc=0} 10:35:10.702817 --- ParallelTerminationStrategy: PID 8851 died... 10:35:10.722808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8851): Terminated: ok {rc=0} 10:35:10.810937 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:35:12.115082 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:12.121205 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:35:12.153339 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:35:12.193149 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:35:12.280114 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:35:12.312033 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:35:12.350270 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:35:12.942837 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:35:12.991911 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:13.002848 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:35:13.075795 tst cs_paging_gprs_active.py: using LAC 40332 10:35:13.194353 tst cs_paging_gprs_active.py: using RAC 42 10:35:13.313603 tst cs_paging_gprs_active.py: using CellId 40332 10:35:13.441401 tst cs_paging_gprs_active.py: using BVCI 40333 10:35:13.552144 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:13.563205 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:13.573998 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:13.584720 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:13.595719 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:13.607312 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:13.618516 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:13.629502 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:13.641011 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:35:13.762932 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:35:13.885157 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:35:14.088611 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:35:14.394631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8857): Launched 10:35:14.662483 run iperf3-srv_10.42.42.10(pid=8858): Launched 10:35:14.779020 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:35:14.982547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:35:15.288604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8859): Launched 10:35:15.554785 run iperf3-srv_10.42.42.10(pid=8860): Launched 10:35:15.671048 tst cs_paging_gprs_active.py:38: start network... 10:35:15.885834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:16.366900 run create_hlr_db(pid=8861): Launched 10:35:16.527191 bus /gobi_6: Setting Powered False 10:35:17.591971 run create_hlr_db(pid=8861): Terminated: ok {rc=0} 10:35:18.026991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8863): Launched 10:35:18.333577 run osmo-hlr_10.42.42.2(pid=8864): Launched 10:35:18.449823 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:18.986267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8866): Launched 10:35:19.291502 run osmo-stp_10.42.42.5(pid=8867): Launched 10:35:19.407800 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:35:19.931767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8869): Launched 10:35:20.049353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:35:20.310518 run patchelf(pid=8870): Launched 10:35:20.480299 run osmo-stp_10.42.42.5(pid=8867): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8867)] 10:35:20.610244 run osmo-stp_10.42.42.5(pid=8867): stdout: | (launched: 2022-12-14_10:35:19.235238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:20.741418 run osmo-stp_10.42.42.5(pid=8867): stderr: | 20221214103519403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103519403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103519404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103519404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103519404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103519405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103519405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:20.872250 run osmo-stp_10.42.42.5(pid=8867): stdout: | (launched: 2022-12-14_10:35:19.235238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:20.997626 run osmo-stp_10.42.42.5(pid=8867): stderr: | 20221214103519403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103519403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103519404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103519404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103519404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103519405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103519405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:21.145724 run patchelf(pid=8870): Terminating (SIGINT) 10:35:21.317960 run patchelf(pid=8870): Terminated: ok {rc=0} 10:35:21.441779 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8867): Process ended prematurely: osmo-stp_10.42.42.5(pid=8867) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8867)] [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:35:21.451478 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 10:35:21.478825 run osmo-hlr_10.42.42.2(pid=8864): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8864)] 10:35:21.528607 run osmo-hlr_10.42.42.2(pid=8864): stdout: | (launched: 2022-12-14_10:35:18.277141) 10:35:21.579084 run osmo-hlr_10.42.42.2(pid=8864): stderr: | 20221214103518454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103518454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103518454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103518454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103518454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103518454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103518471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103518480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103518480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103518481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:21.629922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8857): Terminating (SIGTERM) 10:35:21.670581 run iperf3-srv_10.42.42.10(pid=8858): Terminating (SIGTERM) 10:35:21.711185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8859): Terminating (SIGTERM) 10:35:21.751721 run iperf3-srv_10.42.42.10(pid=8860): Terminating (SIGTERM) 10:35:21.792317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8863): Terminating (SIGTERM) 10:35:21.833258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8866): Terminating (SIGTERM) 10:35:21.873911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8869): Terminating (SIGTERM) 10:35:21.914884 --- ParallelTerminationStrategy: PID 8857 died... 10:35:21.934916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8857): Terminated: ok {rc=0} 10:35:21.979657 --- ParallelTerminationStrategy: PID 8858 died... 10:35:21.999054 run iperf3-srv_10.42.42.10(pid=8858): Terminated {rc=256} 10:35:22.043814 --- ParallelTerminationStrategy: PID 8859 died... 10:35:22.063313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8859): Terminated: ok {rc=0} 10:35:22.108283 --- ParallelTerminationStrategy: PID 8860 died... 10:35:22.127699 run iperf3-srv_10.42.42.10(pid=8860): Terminated {rc=256} 10:35:22.172231 --- ParallelTerminationStrategy: PID 8863 died... 10:35:22.191752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8863): Terminated: ok {rc=0} 10:35:22.236728 --- ParallelTerminationStrategy: PID 8866 died... 10:35:22.256222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8866): Terminated: ok {rc=0} 10:35:22.301219 --- ParallelTerminationStrategy: PID 8869 died... 10:35:22.320545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8869): Terminated: ok {rc=0} 10:35:22.408394 bus /gobi_0: Setting Powered False 10:35:23.508369 bus /gobi_0: Setting Powered False 10:35:24.623818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:35:25.771586 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:25.783145 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:35:25.853908 tst iperf3.py: using LAC 40333 10:35:25.974670 tst iperf3.py: using RAC 43 10:35:26.098546 tst iperf3.py: using CellId 40333 10:35:26.216245 tst iperf3.py: using BVCI 40334 10:35:26.326513 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:26.337543 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:26.348262 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:26.359051 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:26.370049 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:26.381549 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:26.392666 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:26.403620 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:26.414727 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:35:26.530019 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:35:26.732256 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:35:27.036684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8871): Launched 10:35:27.301605 run iperf3-srv_10.42.42.10(pid=8872): Launched 10:35:27.415082 tst iperf3.py:8: start network... 10:35:27.616052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:28.082900 run create_hlr_db(pid=8873): Launched 10:35:28.197617 bus /gobi_6: Setting Powered False 10:35:29.257490 run create_hlr_db(pid=8873): Terminated: ok {rc=0} 10:35:29.678742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8875): Launched 10:35:29.981222 run osmo-hlr_10.42.42.2(pid=8876): Launched 10:35:30.096810 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:30.632374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8878): Launched 10:35:30.953663 run osmo-stp_10.42.42.5(pid=8879): Launched 10:35:31.203549 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:35:31.842218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8881): Launched 10:35:31.974784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:35:32.255749 run patchelf(pid=8882): Launched 10:35:32.447590 run osmo-stp_10.42.42.5(pid=8879): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8879)] 10:35:32.583982 run osmo-stp_10.42.42.5(pid=8879): stdout: | (launched: 2022-12-14_10:35:30.884846) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:32.721998 run osmo-stp_10.42.42.5(pid=8879): stderr: | 20221214103531234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103531234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103531234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103531235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103531235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103531235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103531235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:32.859997 run osmo-stp_10.42.42.5(pid=8879): stdout: | (launched: 2022-12-14_10:35:30.884846) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:32.992633 run osmo-stp_10.42.42.5(pid=8879): stderr: | 20221214103531234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103531234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103531234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103531235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103531235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103531235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103531235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:33.148528 run patchelf(pid=8882): Terminating (SIGINT) 10:35:33.330163 run patchelf(pid=8882): Terminated: ok {rc=0} 10:35:33.461143 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8879): Process ended prematurely: osmo-stp_10.42.42.5(pid=8879) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8879)] [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 10:35:33.471700 tst iperf3.py:8: Test FAILED (7.7 sec) 10:35:33.500585 run osmo-hlr_10.42.42.2(pid=8876): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8876)] 10:35:33.551081 run osmo-hlr_10.42.42.2(pid=8876): stdout: | (launched: 2022-12-14_10:35:29.925120) 10:35:33.603424 run osmo-hlr_10.42.42.2(pid=8876): stderr: | 20221214103530100 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103530100 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103530100 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103530100 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103530100 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103530100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103530113 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103530121 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103530121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103530121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:33.656395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8871): Terminating (SIGTERM) 10:35:33.698613 run iperf3-srv_10.42.42.10(pid=8872): Terminating (SIGTERM) 10:35:33.740815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8875): Terminating (SIGTERM) 10:35:33.783074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8878): Terminating (SIGTERM) 10:35:33.825388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8881): Terminating (SIGTERM) 10:35:33.868113 --- ParallelTerminationStrategy: PID 8871 died... 10:35:33.888405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8871): Terminated: ok {rc=0} 10:35:33.935094 --- ParallelTerminationStrategy: PID 8872 died... 10:35:33.954739 run iperf3-srv_10.42.42.10(pid=8872): Terminated {rc=256} 10:35:34.001077 --- ParallelTerminationStrategy: PID 8875 died... 10:35:34.020766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8875): Terminated: ok {rc=0} 10:35:34.067191 --- ParallelTerminationStrategy: PID 8878 died... 10:35:34.086761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8878): Terminated: ok {rc=0} 10:35:34.133148 --- ParallelTerminationStrategy: PID 8881 died... 10:35:34.152716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8881): Terminated: ok {rc=0} 10:35:34.241310 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:35:35.388277 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:35.400133 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:35:35.469781 tst iperf3m4.py: using LAC 40334 10:35:35.589771 tst iperf3m4.py: using RAC 44 10:35:35.709180 tst iperf3m4.py: using CellId 40334 10:35:35.826546 tst iperf3m4.py: using BVCI 40335 10:35:35.938250 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:35.949410 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:35.960266 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:35.971161 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:35.982308 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:35.994226 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:36.005620 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:36.016659 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:36.028052 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:35:36.150011 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:35:36.270984 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:35:36.391997 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:35:36.514395 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:35:36.730102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:35:37.053436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8883): Launched 10:35:37.334038 run iperf3-srv_10.42.42.10(pid=8884): Launched 10:35:37.455318 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:35:37.670223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:35:37.992708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8885): Launched 10:35:38.274737 run iperf3-srv_10.42.42.10(pid=8886): Launched 10:35:38.395445 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:35:38.610000 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:35:38.931817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8887): Launched 10:35:39.213399 run iperf3-srv_10.42.42.10(pid=8888): Launched 10:35:39.335043 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:35:39.549771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:35:39.871743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8889): Launched 10:35:40.151425 run iperf3-srv_10.42.42.10(pid=8890): Launched 10:35:40.272776 tst iperf3m4.py:8: start network... 10:35:40.488449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:40.986016 run create_hlr_db(pid=8891): Launched 10:35:41.119222 bus /gobi_6: Setting Powered False 10:35:42.179241 run create_hlr_db(pid=8891): Terminated: ok {rc=0} 10:35:42.630179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8893): Launched 10:35:42.953446 run osmo-hlr_10.42.42.2(pid=8894): Launched 10:35:43.075492 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:43.629899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8896): Launched 10:35:43.953179 run osmo-stp_10.42.42.5(pid=8897): Launched 10:35:44.074902 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:35:44.629563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8899): Launched 10:35:44.755127 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:35:45.028224 run patchelf(pid=8900): Launched 10:35:45.209053 run osmo-stp_10.42.42.5(pid=8897): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8897)] 10:35:45.344718 run osmo-stp_10.42.42.5(pid=8897): stdout: | (launched: 2022-12-14_10:35:43.893185) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:45.482092 run osmo-stp_10.42.42.5(pid=8897): stderr: | 20221214103544083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103544083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103544084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103544084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103544085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103544085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103544085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:45.620165 run osmo-stp_10.42.42.5(pid=8897): stdout: | (launched: 2022-12-14_10:35:43.893185) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:45.751504 run osmo-stp_10.42.42.5(pid=8897): stderr: | 20221214103544083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103544083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103544084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103544084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103544085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103544085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103544085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:45.914816 run patchelf(pid=8900): Terminating (SIGINT) 10:35:46.098887 run patchelf(pid=8900): Terminated: ok {rc=0} 10:35:46.231965 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8897): Process ended prematurely: osmo-stp_10.42.42.5(pid=8897) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8897)] [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:35:46.243051 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:35:46.273019 run osmo-hlr_10.42.42.2(pid=8894): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8894)] 10:35:46.324862 run osmo-hlr_10.42.42.2(pid=8894): stdout: | (launched: 2022-12-14_10:35:42.893429) 10:35:46.378565 run osmo-hlr_10.42.42.2(pid=8894): stderr: | 20221214103543093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103543093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103543093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103543093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103543093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103543093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103543105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103543114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103543114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103543114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:46.432919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8883): Terminating (SIGTERM) 10:35:46.475827 run iperf3-srv_10.42.42.10(pid=8884): Terminating (SIGTERM) 10:35:46.518915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8885): Terminating (SIGTERM) 10:35:46.562081 run iperf3-srv_10.42.42.10(pid=8886): Terminating (SIGTERM) 10:35:46.604915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8887): Terminating (SIGTERM) 10:35:46.647903 run iperf3-srv_10.42.42.10(pid=8888): Terminating (SIGTERM) 10:35:46.690732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8889): Terminating (SIGTERM) 10:35:46.733813 run iperf3-srv_10.42.42.10(pid=8890): Terminating (SIGTERM) 10:35:46.776587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8893): Terminating (SIGTERM) 10:35:46.820192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8896): Terminating (SIGTERM) 10:35:46.864592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8899): Terminating (SIGTERM) 10:35:46.908340 --- ParallelTerminationStrategy: PID 8883 died... 10:35:46.929111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8883): Terminated: ok {rc=0} 10:35:46.976834 --- ParallelTerminationStrategy: PID 8884 died... 10:35:46.997412 run iperf3-srv_10.42.42.10(pid=8884): Terminated {rc=256} 10:35:47.045260 --- ParallelTerminationStrategy: PID 8885 died... 10:35:47.065867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8885): Terminated: ok {rc=0} 10:35:47.113705 --- ParallelTerminationStrategy: PID 8886 died... 10:35:47.134183 run iperf3-srv_10.42.42.10(pid=8886): Terminated {rc=256} 10:35:47.181673 --- ParallelTerminationStrategy: PID 8887 died... 10:35:47.202188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8887): Terminated: ok {rc=0} 10:35:47.249775 --- ParallelTerminationStrategy: PID 8888 died... 10:35:47.270140 run iperf3-srv_10.42.42.10(pid=8888): Terminated {rc=256} 10:35:47.316735 --- ParallelTerminationStrategy: PID 8889 died... 10:35:47.336698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8889): Terminated: ok {rc=0} 10:35:47.383498 --- ParallelTerminationStrategy: PID 8890 died... 10:35:47.403347 run iperf3-srv_10.42.42.10(pid=8890): Terminated {rc=256} 10:35:47.449838 --- ParallelTerminationStrategy: PID 8893 died... 10:35:47.469808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8893): Terminated: ok {rc=0} 10:35:47.516202 --- ParallelTerminationStrategy: PID 8896 died... 10:35:47.536203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8896): Terminated: ok {rc=0} 10:35:47.582708 --- ParallelTerminationStrategy: PID 8899 died... 10:35:47.602449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8899): Terminated: ok {rc=0} 10:35:47.690516 bus /gobi_4: Setting Powered False 10:35:48.790984 bus /gobi_4: Setting Powered False 10:35:49.910379 bus /gobi_1: Setting Powered False 10:35:51.010067 bus /gobi_1: Setting Powered False 10:35:52.128052 bus /gobi_0: Setting Powered False 10:35:53.228117 bus /gobi_0: Setting Powered False 10:35:54.346328 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:35:55.451280 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:55.462969 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:35:55.533392 tst ping.py: using LAC 40335 10:35:55.650965 tst ping.py: using RAC 45 10:35:55.769512 tst ping.py: using CellId 40335 10:35:55.894844 tst ping.py: using BVCI 40336 10:35:56.011110 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:56.022608 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:56.034237 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:56.045506 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:56.056747 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:56.068291 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:56.079841 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:35:56.091131 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:35:56.207358 tst ping.py:19: start network... 10:35:56.405179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:56.866440 run create_hlr_db(pid=8901): Launched 10:35:56.983201 bus /gobi_6: Setting Powered False 10:35:58.043274 run create_hlr_db(pid=8901): Terminated: ok {rc=0} 10:35:58.480054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8903): Launched 10:35:58.799633 run osmo-hlr_10.42.42.2(pid=8904): Launched 10:35:58.921237 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:59.467148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8906): Launched 10:35:59.783575 run osmo-stp_10.42.42.5(pid=8907): Launched 10:35:59.905190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:36:00.450278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8909): Launched 10:36:00.572899 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:36:00.845778 run patchelf(pid=8910): Launched 10:36:01.058808 run osmo-stp_10.42.42.5(pid=8907): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8907)] 10:36:01.191487 run osmo-stp_10.42.42.5(pid=8907): stdout: | (launched: 2022-12-14_10:35:59.725515) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:01.325706 run osmo-stp_10.42.42.5(pid=8907): stderr: | 20221214103559916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103559916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103559917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103559917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103559918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103559918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103559918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:01.460932 run osmo-stp_10.42.42.5(pid=8907): stdout: | (launched: 2022-12-14_10:35:59.725515) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:01.587949 run osmo-stp_10.42.42.5(pid=8907): stderr: | 20221214103559916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103559916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103559917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103559917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103559918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103559918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103559918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:01.739102 run patchelf(pid=8910): Terminating (SIGINT) 10:36:01.913819 run patchelf(pid=8910): Terminated: ok {rc=0} 10:36:02.039990 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8907): Process ended prematurely: osmo-stp_10.42.42.5(pid=8907) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8907)] [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 10:36:02.051857 tst ping.py:22: Test FAILED (6.6 sec) 10:36:02.080577 run osmo-hlr_10.42.42.2(pid=8904): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8904)] 10:36:02.131739 run osmo-hlr_10.42.42.2(pid=8904): stdout: | (launched: 2022-12-14_10:35:58.741302) 10:36:02.186302 run osmo-hlr_10.42.42.2(pid=8904): stderr: | 20221214103558938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103558938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103558938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103558938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103558938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103558938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103558950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103558958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103558958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103558958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:02.237461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8903): Terminating (SIGTERM) 10:36:02.278784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8906): Terminating (SIGTERM) 10:36:02.319803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8909): Terminating (SIGTERM) 10:36:02.360919 --- ParallelTerminationStrategy: PID 8903 died... 10:36:02.380897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8903): Terminated: ok {rc=0} 10:36:02.426086 --- ParallelTerminationStrategy: PID 8906 died... 10:36:02.445521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8906): Terminated: ok {rc=0} 10:36:02.490224 --- ParallelTerminationStrategy: PID 8909 died... 10:36:02.509669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8909): Terminated: ok {rc=0} 10:36:02.597502 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:36:03.687160 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:36:03.699529 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:36:03.774758 tst ping_idle_ping.py: using LAC 40336 10:36:03.901522 tst ping_idle_ping.py: using RAC 46 10:36:04.028051 tst ping_idle_ping.py: using CellId 40336 10:36:04.152844 tst ping_idle_ping.py: using BVCI 40337 10:36:04.267877 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:36:04.279297 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:36:04.290604 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:36:04.301880 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:36:04.313092 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:36:04.324343 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:36:04.335832 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:36:04.347169 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:36:04.465952 tst ping_idle_ping.py:24: start network... 10:36:04.665649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:05.127152 run create_hlr_db(pid=8911): Launched 10:36:05.241724 bus /gobi_6: Setting Powered False 10:36:06.301190 run create_hlr_db(pid=8911): Terminated: ok {rc=0} 10:36:06.719348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8913): Launched 10:36:07.018792 run osmo-hlr_10.42.42.2(pid=8914): Launched 10:36:07.133802 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:07.664536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8916): Launched 10:36:07.965655 run osmo-stp_10.42.42.5(pid=8917): Launched 10:36:08.081744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:36:08.598087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8919): Launched 10:36:08.715095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:36:08.968181 run patchelf(pid=8920): Launched 10:36:09.135134 run osmo-stp_10.42.42.5(pid=8917): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8917)] 10:36:09.262367 run osmo-stp_10.42.42.5(pid=8917): stdout: | (launched: 2022-12-14_10:36:07.910191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:09.391630 run osmo-stp_10.42.42.5(pid=8917): stderr: | 20221214103608080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103608081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103608081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103608081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103608082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103608082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103608082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:09.520658 run osmo-stp_10.42.42.5(pid=8917): stdout: | (launched: 2022-12-14_10:36:07.910191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:09.643535 run osmo-stp_10.42.42.5(pid=8917): stderr: | 20221214103608080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103608081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103608081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103608081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103608082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103608082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103608082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:09.788923 run patchelf(pid=8920): Terminating (SIGINT) 10:36:09.958151 run patchelf(pid=8920): Terminated: ok {rc=0} 10:36:10.080103 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8917): Process ended prematurely: osmo-stp_10.42.42.5(pid=8917) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8917)] [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:36:10.089264 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:36:10.116523 run osmo-hlr_10.42.42.2(pid=8914): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8914)] 10:36:10.165363 run osmo-hlr_10.42.42.2(pid=8914): stdout: | (launched: 2022-12-14_10:36:06.963443) 10:36:10.215462 run osmo-hlr_10.42.42.2(pid=8914): stderr: | 20221214103607137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103607138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103607138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103607138 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103607138 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103607138 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103607150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103607159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103607159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103607159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:10.266239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8913): Terminating (SIGTERM) 10:36:10.306681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8916): Terminating (SIGTERM) 10:36:10.347329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8919): Terminating (SIGTERM) 10:36:10.388237 --- ParallelTerminationStrategy: PID 8913 died... 10:36:10.408005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8913): Terminated: ok {rc=0} 10:36:10.452851 --- ParallelTerminationStrategy: PID 8916 died... 10:36:10.472369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8916): Terminated: ok {rc=0} 10:36:10.516900 --- ParallelTerminationStrategy: PID 8919 died... 10:36:10.536095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8919): Terminated: ok {rc=0} 10:36:10.620900 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:36:11.928427 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:36:11.936143 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:36:11.973530 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 10:36:12.015227 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 10:36:12.106709 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:36:12.140321 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 10:36:12.179860 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 10:36:12.780054 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 10:36:12.830755 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:12.842007 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:36:12.893370 tst cs_paging_gprs_active.py: using LAC 40337 10:36:13.015920 tst cs_paging_gprs_active.py: using RAC 47 10:36:13.135577 tst cs_paging_gprs_active.py: using CellId 40337 10:36:13.253775 tst cs_paging_gprs_active.py: using BVCI 40338 10:36:13.365882 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:13.377065 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:13.388010 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:13.399123 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:13.410499 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:13.421864 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:13.433293 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:13.444523 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:13.456047 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:36:13.577871 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:36:13.695914 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:36:13.899655 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:14.205558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8925): Launched 10:36:14.472052 run iperf3-srv_10.42.42.10(pid=8926): Launched 10:36:14.587101 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:36:14.790688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:15.097279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8927): Launched 10:36:15.363755 run iperf3-srv_10.42.42.10(pid=8928): Launched 10:36:15.478647 tst cs_paging_gprs_active.py:38: start network... 10:36:15.681692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:16.161476 run create_hlr_db(pid=8929): Launched 10:36:16.316263 bus /gobi_6: Setting Powered False 10:36:17.377728 run create_hlr_db(pid=8929): Terminated: ok {rc=0} 10:36:17.822423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8931): Launched 10:36:18.131686 run osmo-hlr_10.42.42.2(pid=8932): Launched 10:36:18.248314 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:18.774817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8934): Launched 10:36:19.079185 run osmo-stp_10.42.42.5(pid=8935): Launched 10:36:19.195636 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:36:19.719245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8937): Launched 10:36:19.837129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:36:20.094683 run patchelf(pid=8938): Launched 10:36:20.264858 run osmo-stp_10.42.42.5(pid=8935): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8935)] 10:36:20.394557 run osmo-stp_10.42.42.5(pid=8935): stdout: | (launched: 2022-12-14_10:36:19.023062) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:20.525390 run osmo-stp_10.42.42.5(pid=8935): stderr: | 20221214103619193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103619193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103619194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103619194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103619194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103619194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103619195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:20.656267 run osmo-stp_10.42.42.5(pid=8935): stdout: | (launched: 2022-12-14_10:36:19.023062) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:20.780894 run osmo-stp_10.42.42.5(pid=8935): stderr: | 20221214103619193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103619193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103619194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103619194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103619194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103619194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103619195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:20.928437 run patchelf(pid=8938): Terminating (SIGINT) 10:36:21.100295 run patchelf(pid=8938): Terminated: ok {rc=0} 10:36:21.224125 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8935): Process ended prematurely: osmo-stp_10.42.42.5(pid=8935) [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8935)] [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 10:36:21.233970 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 10:36:21.261499 run osmo-hlr_10.42.42.2(pid=8932): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8932)] 10:36:21.309770 run osmo-hlr_10.42.42.2(pid=8932): stdout: | (launched: 2022-12-14_10:36:18.075196) 10:36:21.359722 run osmo-hlr_10.42.42.2(pid=8932): stderr: | 20221214103618252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103618252 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103618252 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103618252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103618252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103618252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103618267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103618277 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103618277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103618277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:21.410201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8925): Terminating (SIGTERM) 10:36:21.450797 run iperf3-srv_10.42.42.10(pid=8926): Terminating (SIGTERM) 10:36:21.491515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8927): Terminating (SIGTERM) 10:36:21.531982 run iperf3-srv_10.42.42.10(pid=8928): Terminating (SIGTERM) 10:36:21.572370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8931): Terminating (SIGTERM) 10:36:21.612832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8934): Terminating (SIGTERM) 10:36:21.653275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8937): Terminating (SIGTERM) 10:36:21.694081 --- ParallelTerminationStrategy: PID 8925 died... 10:36:21.713652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8925): Terminated: ok {rc=0} 10:36:21.758489 --- ParallelTerminationStrategy: PID 8926 died... 10:36:21.777555 run iperf3-srv_10.42.42.10(pid=8926): Terminated {rc=256} 10:36:21.821862 --- ParallelTerminationStrategy: PID 8927 died... 10:36:21.840779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8927): Terminated: ok {rc=0} 10:36:21.885217 --- ParallelTerminationStrategy: PID 8928 died... 10:36:21.904315 run iperf3-srv_10.42.42.10(pid=8928): Terminated {rc=256} 10:36:21.948580 --- ParallelTerminationStrategy: PID 8931 died... 10:36:21.967739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8931): Terminated: ok {rc=0} 10:36:22.011995 --- ParallelTerminationStrategy: PID 8934 died... 10:36:22.031126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8934): Terminated: ok {rc=0} 10:36:22.075395 --- ParallelTerminationStrategy: PID 8937 died... 10:36:22.094411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8937): Terminated: ok {rc=0} 10:36:22.178508 bus /gobi_0: Setting Powered False 10:36:23.278443 bus /gobi_0: Setting Powered False 10:36:24.396498 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 10:36:25.541574 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:25.553488 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:36:25.608067 tst iperf3.py: using LAC 40338 10:36:25.728084 tst iperf3.py: using RAC 48 10:36:25.848084 tst iperf3.py: using CellId 40338 10:36:25.968319 tst iperf3.py: using BVCI 40339 10:36:26.079979 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:26.091326 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:26.102499 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:26.113663 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:26.125105 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:26.136318 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:26.147753 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:26.159068 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:26.170672 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:36:26.290539 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:36:26.508809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:26.834487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8939): Launched 10:36:27.118422 run iperf3-srv_10.42.42.10(pid=8940): Launched 10:36:27.241073 tst iperf3.py:8: start network... 10:36:27.458061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:27.933480 run create_hlr_db(pid=8941): Launched 10:36:28.049080 bus /gobi_6: Setting Powered False 10:36:29.109237 run create_hlr_db(pid=8941): Terminated: ok {rc=0} 10:36:29.551846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8943): Launched 10:36:29.877847 run osmo-hlr_10.42.42.2(pid=8944): Launched 10:36:30.004169 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:30.559755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8946): Launched 10:36:30.893794 run osmo-stp_10.42.42.5(pid=8947): Launched 10:36:31.136526 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:36:31.769819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8949): Launched 10:36:31.906644 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:36:32.194880 run patchelf(pid=8950): Launched 10:36:32.385278 run osmo-stp_10.42.42.5(pid=8947): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8947)] 10:36:32.522723 run osmo-stp_10.42.42.5(pid=8947): stdout: | (launched: 2022-12-14_10:36:30.825271) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:32.661577 run osmo-stp_10.42.42.5(pid=8947): stderr: | 20221214103631143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103631144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103631144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103631144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103631148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103631152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103631152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:32.801121 run osmo-stp_10.42.42.5(pid=8947): stdout: | (launched: 2022-12-14_10:36:30.825271) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:32.933952 run osmo-stp_10.42.42.5(pid=8947): stderr: | 20221214103631143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103631144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103631144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103631144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103631148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103631152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103631152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:33.091166 run patchelf(pid=8950): Terminating (SIGINT) 10:36:33.272923 run patchelf(pid=8950): Terminated: ok {rc=0} 10:36:33.404302 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8947): Process ended prematurely: osmo-stp_10.42.42.5(pid=8947) [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8947)] [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 10:36:33.414855 tst iperf3.py:8: Test FAILED (7.9 sec) 10:36:33.443779 run osmo-hlr_10.42.42.2(pid=8944): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8944)] 10:36:33.494222 run osmo-hlr_10.42.42.2(pid=8944): stdout: | (launched: 2022-12-14_10:36:29.818710) 10:36:33.546604 run osmo-hlr_10.42.42.2(pid=8944): stderr: | 20221214103630015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103630016 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103630016 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103630016 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103630016 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103630016 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103630031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103630041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103630041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103630041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:33.599123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8939): Terminating (SIGTERM) 10:36:33.641470 run iperf3-srv_10.42.42.10(pid=8940): Terminating (SIGTERM) 10:36:33.684060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8943): Terminating (SIGTERM) 10:36:33.726848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8946): Terminating (SIGTERM) 10:36:33.769224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8949): Terminating (SIGTERM) 10:36:33.811476 --- ParallelTerminationStrategy: PID 8939 died... 10:36:33.831932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8939): Terminated: ok {rc=0} 10:36:33.878739 --- ParallelTerminationStrategy: PID 8940 died... 10:36:33.898427 run iperf3-srv_10.42.42.10(pid=8940): Terminated {rc=256} 10:36:33.944756 --- ParallelTerminationStrategy: PID 8943 died... 10:36:33.964595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8943): Terminated: ok {rc=0} 10:36:34.010984 --- ParallelTerminationStrategy: PID 8946 died... 10:36:34.030569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8946): Terminated: ok {rc=0} 10:36:34.076814 --- ParallelTerminationStrategy: PID 8949 died... 10:36:34.097247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8949): Terminated: ok {rc=0} 10:36:34.186094 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 10:36:35.336692 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:35.349463 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:36:35.403765 tst iperf3m4.py: using LAC 40339 10:36:35.529912 tst iperf3m4.py: using RAC 49 10:36:35.660078 tst iperf3m4.py: using CellId 40339 10:36:35.786821 tst iperf3m4.py: using BVCI 40340 10:36:35.903725 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:35.915562 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:35.927230 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:35.938890 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:35.950842 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:35.962602 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:35.974569 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:35.986484 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:35.998435 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:36:36.117549 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:36:36.239545 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:36:36.358552 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:36:36.478508 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:36:36.695785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:37.023887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8951): Launched 10:36:37.307685 run iperf3-srv_10.42.42.10(pid=8952): Launched 10:36:37.430640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:36:37.647738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:37.973510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8953): Launched 10:36:38.255673 run iperf3-srv_10.42.42.10(pid=8954): Launched 10:36:38.378431 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:36:38.595264 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:38.921203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8955): Launched 10:36:39.203609 run iperf3-srv_10.42.42.10(pid=8956): Launched 10:36:39.324660 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:36:39.541306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:39.865756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8957): Launched 10:36:40.149377 run iperf3-srv_10.42.42.10(pid=8958): Launched 10:36:40.270555 tst iperf3m4.py:8: start network... 10:36:40.488411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:40.991380 run create_hlr_db(pid=8959): Launched 10:36:41.122633 bus /gobi_6: Setting Powered False 10:36:42.186739 run create_hlr_db(pid=8959): Terminated: ok {rc=0} 10:36:42.621634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8961): Launched 10:36:42.928403 run osmo-hlr_10.42.42.2(pid=8962): Launched 10:36:43.046253 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:43.581431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8964): Launched 10:36:43.886640 run osmo-stp_10.42.42.5(pid=8965): Launched 10:36:44.002231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:36:44.525498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8967): Launched 10:36:44.642002 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:36:44.899250 run patchelf(pid=8968): Launched 10:36:45.070847 run osmo-stp_10.42.42.5(pid=8965): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8965)] 10:36:45.199937 run osmo-stp_10.42.42.5(pid=8965): stdout: | (launched: 2022-12-14_10:36:43.830268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:45.330619 run osmo-stp_10.42.42.5(pid=8965): stderr: | 20221214103643997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103643998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103643998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103643998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103643999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103643999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103643999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:45.460775 run osmo-stp_10.42.42.5(pid=8965): stdout: | (launched: 2022-12-14_10:36:43.830268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:45.585338 run osmo-stp_10.42.42.5(pid=8965): stderr: | 20221214103643997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103643998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103643998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103643998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103643999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103643999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103643999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:45.732630 run patchelf(pid=8968): Terminating (SIGINT) 10:36:45.939600 run patchelf(pid=8968): Terminated: ok {rc=0} 10:36:46.098334 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8965): Process ended prematurely: osmo-stp_10.42.42.5(pid=8965) [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8965)] [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 10:36:46.110185 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:36:46.141753 run osmo-hlr_10.42.42.2(pid=8962): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8962)] 10:36:46.198015 run osmo-hlr_10.42.42.2(pid=8962): stdout: | (launched: 2022-12-14_10:36:42.871788) 10:36:46.255515 run osmo-hlr_10.42.42.2(pid=8962): stderr: | 20221214103643049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103643049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103643049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103643049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103643049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103643049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103643062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103643071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103643071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103643071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:46.312221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8951): Terminating (SIGTERM) 10:36:46.356449 run iperf3-srv_10.42.42.10(pid=8952): Terminating (SIGTERM) 10:36:46.401192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8953): Terminating (SIGTERM) 10:36:46.446509 run iperf3-srv_10.42.42.10(pid=8954): Terminating (SIGTERM) 10:36:46.490829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8955): Terminating (SIGTERM) 10:36:46.535993 run iperf3-srv_10.42.42.10(pid=8956): Terminating (SIGTERM) 10:36:46.580451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8957): Terminating (SIGTERM) 10:36:46.624753 run iperf3-srv_10.42.42.10(pid=8958): Terminating (SIGTERM) 10:36:46.670856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8961): Terminating (SIGTERM) 10:36:46.715924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8964): Terminating (SIGTERM) 10:36:46.762360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8967): Terminating (SIGTERM) 10:36:46.809296 --- ParallelTerminationStrategy: PID 8951 died... 10:36:46.831716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8951): Terminated: ok {rc=0} 10:36:46.883450 --- ParallelTerminationStrategy: PID 8952 died... 10:36:46.904782 run iperf3-srv_10.42.42.10(pid=8952): Terminated {rc=256} 10:36:46.954390 --- ParallelTerminationStrategy: PID 8953 died... 10:36:46.976002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8953): Terminated: ok {rc=0} 10:36:47.025527 --- ParallelTerminationStrategy: PID 8954 died... 10:36:47.048629 run iperf3-srv_10.42.42.10(pid=8954): Terminated {rc=256} 10:36:47.097435 --- ParallelTerminationStrategy: PID 8955 died... 10:36:47.119037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8955): Terminated: ok {rc=0} 10:36:47.168488 --- ParallelTerminationStrategy: PID 8956 died... 10:36:47.190211 run iperf3-srv_10.42.42.10(pid=8956): Terminated {rc=256} 10:36:47.239045 --- ParallelTerminationStrategy: PID 8957 died... 10:36:47.259978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8957): Terminated: ok {rc=0} 10:36:47.307233 --- ParallelTerminationStrategy: PID 8958 died... 10:36:47.327677 run iperf3-srv_10.42.42.10(pid=8958): Terminated {rc=256} 10:36:47.374655 --- ParallelTerminationStrategy: PID 8961 died... 10:36:47.395280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8961): Terminated: ok {rc=0} 10:36:47.442972 --- ParallelTerminationStrategy: PID 8964 died... 10:36:47.463521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8964): Terminated: ok {rc=0} 10:36:47.510823 --- ParallelTerminationStrategy: PID 8967 died... 10:36:47.531568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8967): Terminated: ok {rc=0} 10:36:47.621945 bus /gobi_4: Setting Powered False 10:36:48.720573 bus /gobi_4: Setting Powered False 10:36:49.837737 bus /gobi_1: Setting Powered False 10:36:50.937130 bus /gobi_1: Setting Powered False 10:36:52.055183 bus /gobi_0: Setting Powered False 10:36:53.154353 bus /gobi_0: Setting Powered False 10:36:54.271522 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 10:36:55.374420 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:55.386830 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:36:55.440343 tst ping.py: using LAC 40340 10:36:55.565681 tst ping.py: using RAC 50 10:36:55.689297 tst ping.py: using CellId 40340 10:36:55.812931 tst ping.py: using BVCI 40341 10:36:55.929143 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:55.940916 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:55.952618 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:55.964470 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:55.976020 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:55.987635 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:55.999259 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:36:56.010894 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:36:56.132180 tst ping.py:19: start network... 10:36:56.345755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:56.834471 run create_hlr_db(pid=8969): Launched 10:36:56.964030 bus /gobi_6: Setting Powered False 10:36:58.027806 run create_hlr_db(pid=8969): Terminated: ok {rc=0} 10:36:58.471070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8971): Launched 10:36:58.786933 run osmo-hlr_10.42.42.2(pid=8972): Launched 10:36:58.909441 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:59.457719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8974): Launched 10:36:59.777456 run osmo-stp_10.42.42.5(pid=8975): Launched 10:36:59.899929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:00.448501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8977): Launched 10:37:00.569984 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:00.850350 run patchelf(pid=8978): Launched 10:37:01.049835 run osmo-stp_10.42.42.5(pid=8975): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8975)] 10:37:01.188279 run osmo-stp_10.42.42.5(pid=8975): stdout: | (launched: 2022-12-14_10:36:59.718431) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:01.328115 run osmo-stp_10.42.42.5(pid=8975): stderr: | 20221214103659911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103659911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103659911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103659911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103659912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103659912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103659912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:01.468054 run osmo-stp_10.42.42.5(pid=8975): stdout: | (launched: 2022-12-14_10:36:59.718431) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:01.600678 run osmo-stp_10.42.42.5(pid=8975): stderr: | 20221214103659911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103659911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103659911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103659911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103659912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103659912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103659912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:01.758084 run patchelf(pid=8978): Terminating (SIGINT) 10:37:01.941264 run patchelf(pid=8978): Terminated: ok {rc=0} 10:37:02.073148 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8975): Process ended prematurely: osmo-stp_10.42.42.5(pid=8975) [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8975)] [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 10:37:02.083591 tst ping.py:22: Test FAILED (6.7 sec) 10:37:02.113029 run osmo-hlr_10.42.42.2(pid=8972): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8972)] 10:37:02.164510 run osmo-hlr_10.42.42.2(pid=8972): stdout: | (launched: 2022-12-14_10:36:58.728608) 10:37:02.217361 run osmo-hlr_10.42.42.2(pid=8972): stderr: | 20221214103658925 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103658925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103658926 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103658926 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103658926 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103658926 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103658964 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103658974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103658975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103658975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:02.270033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8971): Terminating (SIGTERM) 10:37:02.312226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8974): Terminating (SIGTERM) 10:37:02.354980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8977): Terminating (SIGTERM) 10:37:02.398315 --- ParallelTerminationStrategy: PID 8971 died... 10:37:02.418505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8971): Terminated: ok {rc=0} 10:37:02.464808 --- ParallelTerminationStrategy: PID 8974 died... 10:37:02.485126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8974): Terminated: ok {rc=0} 10:37:02.531299 --- ParallelTerminationStrategy: PID 8977 died... 10:37:02.550946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8977): Terminated: ok {rc=0} 10:37:02.639282 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 10:37:03.729735 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:37:03.741858 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:37:03.796415 tst ping_idle_ping.py: using LAC 40341 10:37:03.920867 tst ping_idle_ping.py: using RAC 51 10:37:04.038581 tst ping_idle_ping.py: using CellId 40341 10:37:04.150268 tst ping_idle_ping.py: using BVCI 40342 10:37:04.254975 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:37:04.266355 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:37:04.277509 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:37:04.288478 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:37:04.299785 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:37:04.311156 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:37:04.322542 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:37:04.333963 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:37:04.452465 tst ping_idle_ping.py:24: start network... 10:37:04.646352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:05.095409 run create_hlr_db(pid=8979): Launched 10:37:05.205557 bus /gobi_6: Setting Powered False 10:37:06.263660 run create_hlr_db(pid=8979): Terminated: ok {rc=0} 10:37:06.687430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8981): Launched 10:37:06.995244 run osmo-hlr_10.42.42.2(pid=8982): Launched 10:37:07.112324 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:07.640553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8984): Launched 10:37:07.947902 run osmo-stp_10.42.42.5(pid=8985): Launched 10:37:08.065350 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:08.593902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8987): Launched 10:37:08.711241 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:08.970915 run patchelf(pid=8988): Launched 10:37:09.142803 run osmo-stp_10.42.42.5(pid=8985): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8985)] 10:37:09.273152 run osmo-stp_10.42.42.5(pid=8985): stdout: | (launched: 2022-12-14_10:37:07.890931) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:09.405480 run osmo-stp_10.42.42.5(pid=8985): stderr: | 20221214103708079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103708080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103708080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103708080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103708081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103708081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103708081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:09.537975 run osmo-stp_10.42.42.5(pid=8985): stdout: | (launched: 2022-12-14_10:37:07.890931) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:09.663930 run osmo-stp_10.42.42.5(pid=8985): stderr: | 20221214103708079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103708080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103708080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103708080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103708081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103708081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103708081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:09.812926 run patchelf(pid=8988): Terminating (SIGINT) 10:37:09.986019 run patchelf(pid=8988): Terminated: ok {rc=0} 10:37:10.110800 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8985): Process ended prematurely: osmo-stp_10.42.42.5(pid=8985) [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8985)] [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 10:37:10.120391 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:37:10.148358 run osmo-hlr_10.42.42.2(pid=8982): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8982)] 10:37:10.198066 run osmo-hlr_10.42.42.2(pid=8982): stdout: | (launched: 2022-12-14_10:37:06.938375) 10:37:10.249694 run osmo-hlr_10.42.42.2(pid=8982): stderr: | 20221214103707129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103707129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103707129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103707129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103707129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103707130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103707179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103707188 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103707188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103707188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:10.301699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8981): Terminating (SIGTERM) 10:37:10.342889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8984): Terminating (SIGTERM) 10:37:10.384084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8987): Terminating (SIGTERM) 10:37:10.425711 --- ParallelTerminationStrategy: PID 8981 died... 10:37:10.445741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8981): Terminated: ok {rc=0} 10:37:10.491831 --- ParallelTerminationStrategy: PID 8984 died... 10:37:10.511283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8984): Terminated: ok {rc=0} 10:37:10.557405 --- ParallelTerminationStrategy: PID 8987 died... 10:37:10.576758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8987): Terminated: ok {rc=0} 10:37:10.663793 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:37:11.974610 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:37:11.981849 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:37:12.014525 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:37:12.050572 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:37:12.107197 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:37:12.139602 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:37:12.174219 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:37:12.739277 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:37:12.744218 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:37:12.755200 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:37:12.828436 tst switch_tch_pdch.py: using LAC 40342 10:37:12.945225 tst switch_tch_pdch.py: using RAC 52 10:37:13.058407 tst switch_tch_pdch.py: using CellId 40342 10:37:13.172586 tst switch_tch_pdch.py: using BVCI 40343 10:37:13.276874 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:37:13.287951 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:37:13.298884 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:37:13.309794 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:37:13.321559 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:37:13.333262 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:37:13.345204 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:37:13.356804 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:37:13.475824 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:37:13.591809 tst switch_tch_pdch.py:51: start network... 10:37:13.785339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:14.231196 run create_hlr_db(pid=8993): Launched 10:37:14.340671 bus /gobi_6: Setting Powered False 10:37:15.397755 run create_hlr_db(pid=8993): Terminated: ok {rc=0} 10:37:15.821373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8995): Launched 10:37:16.145086 run osmo-hlr_10.42.42.2(pid=8996): Launched 10:37:16.292396 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:17.030840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8998): Launched 10:37:17.361699 run osmo-stp_10.42.42.5(pid=8999): Launched 10:37:17.496822 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:17.994348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9001): Launched 10:37:18.105154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:18.348200 run patchelf(pid=9002): Launched 10:37:18.508420 run osmo-stp_10.42.42.5(pid=8999): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8999)] 10:37:18.630611 run osmo-stp_10.42.42.5(pid=8999): stdout: | (launched: 2022-12-14_10:37:17.296144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:18.754891 run osmo-stp_10.42.42.5(pid=8999): stderr: | 20221214103717482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103717482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103717483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103717483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103717484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103717484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103717484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:18.879059 run osmo-stp_10.42.42.5(pid=8999): stdout: | (launched: 2022-12-14_10:37:17.296144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:18.997358 run osmo-stp_10.42.42.5(pid=8999): stderr: | 20221214103717482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103717482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103717483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103717483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103717484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103717484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103717484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:19.137471 run patchelf(pid=9002): Terminating (SIGINT) 10:37:19.300585 run patchelf(pid=9002): Terminated: ok {rc=0} 10:37:19.418170 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8999): Process ended prematurely: osmo-stp_10.42.42.5(pid=8999) [trial-2403↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8999)] [trial-2403↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:37:19.426971 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 10:37:19.453200 run osmo-hlr_10.42.42.2(pid=8996): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8996)] 10:37:19.500765 run osmo-hlr_10.42.42.2(pid=8996): stdout: | (launched: 2022-12-14_10:37:16.084143) 10:37:19.549939 run osmo-hlr_10.42.42.2(pid=8996): stderr: | 20221214103716479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103716479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103716479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103716479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103716480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103716480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103716549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103716567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103716567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103716567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:19.599327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8995): Terminating (SIGTERM) 10:37:19.639148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8998): Terminating (SIGTERM) 10:37:19.678993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9001): Terminating (SIGTERM) 10:37:19.718746 --- ParallelTerminationStrategy: PID 8995 died... 10:37:19.737924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8995): Terminated: ok {rc=0} 10:37:19.781548 --- ParallelTerminationStrategy: PID 8998 died... 10:37:19.800096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8998): Terminated: ok {rc=0} 10:37:19.843520 --- ParallelTerminationStrategy: PID 9001 died... 10:37:19.861913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9001): Terminated: ok {rc=0} 10:37:19.945074 bus /gobi_0: Setting Powered False 10:37:21.038548 bus /gobi_0: Setting Powered False 10:37:22.150168 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:37:23.411701 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:37:23.418709 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:37:23.450847 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:37:23.486051 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:37:23.536994 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:37:23.569163 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:37:23.603071 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:37:24.162984 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:37:24.168445 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:37:24.179741 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:37:24.248940 tst switch_tch_pdch.py: using LAC 40343 10:37:24.368278 tst switch_tch_pdch.py: using RAC 53 10:37:24.487739 tst switch_tch_pdch.py: using CellId 40343 10:37:24.608415 tst switch_tch_pdch.py: using BVCI 40344 10:37:24.719069 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:37:24.730396 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:37:24.741548 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:37:24.752552 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:37:24.763766 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:37:24.774998 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:37:24.786491 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:37:24.797587 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:37:24.915780 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:37:25.031249 tst switch_tch_pdch.py:51: start network... 10:37:25.223280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:25.642993 run create_hlr_db(pid=9006): Launched 10:37:25.752807 bus /gobi_6: Setting Powered False 10:37:26.810541 run create_hlr_db(pid=9006): Terminated: ok {rc=0} 10:37:27.188143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9008): Launched 10:37:27.475549 run osmo-hlr_10.42.42.2(pid=9009): Launched 10:37:27.585819 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:28.058389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9011): Launched 10:37:28.346181 run osmo-stp_10.42.42.5(pid=9012): Launched 10:37:28.455443 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:28.925692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9014): Launched 10:37:29.036265 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:29.278524 run patchelf(pid=9015): Launched 10:37:29.438512 run osmo-stp_10.42.42.5(pid=9012): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9012)] 10:37:29.560845 run osmo-stp_10.42.42.5(pid=9012): stdout: | (launched: 2022-12-14_10:37:28.293099) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:29.684738 run osmo-stp_10.42.42.5(pid=9012): stderr: | 20221214103728456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103728456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103728456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103728457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103728457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103728457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103728457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:29.808773 run osmo-stp_10.42.42.5(pid=9012): stdout: | (launched: 2022-12-14_10:37:28.293099) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:29.926737 run osmo-stp_10.42.42.5(pid=9012): stderr: | 20221214103728456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103728456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103728456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103728457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103728457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103728457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103728457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:30.066016 run patchelf(pid=9015): Terminating (SIGINT) 10:37:30.228743 run patchelf(pid=9015): Terminated: ok {rc=0} 10:37:30.346182 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9012): Process ended prematurely: osmo-stp_10.42.42.5(pid=9012) [trial-2403↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9012)] [trial-2403↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:37:30.355049 tst switch_tch_pdch.py:54: Test FAILED (6.2 sec) 10:37:30.381277 run osmo-hlr_10.42.42.2(pid=9009): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9009)] 10:37:30.428711 run osmo-hlr_10.42.42.2(pid=9009): stdout: | (launched: 2022-12-14_10:37:27.422562) 10:37:30.477760 run osmo-hlr_10.42.42.2(pid=9009): stderr: | 20221214103727592 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103727592 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103727592 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103727592 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103727592 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103727592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103727605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103727614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103727614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103727614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:30.527191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9008): Terminating (SIGTERM) 10:37:30.566774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9011): Terminating (SIGTERM) 10:37:30.606313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9014): Terminating (SIGTERM) 10:37:30.645979 --- ParallelTerminationStrategy: PID 9008 died... 10:37:30.665129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9008): Terminated: ok {rc=0} 10:37:30.708647 --- ParallelTerminationStrategy: PID 9011 died... 10:37:30.727247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9011): Terminated: ok {rc=0} 10:37:30.770793 --- ParallelTerminationStrategy: PID 9014 died... 10:37:30.789414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9014): Terminated: ok {rc=0} 10:37:30.892321 bus /gobi_0: Setting Powered False 10:37:31.996800 bus /gobi_0: Setting Powered False 10:37:33.107633 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_sms:trx-lms --------------------------------------------------------------------- 10:37:34.357190 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:37:34.361342 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 10:37:34.394642 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 10:37:34.401577 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 10:37:34.455173 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 10:37:34.487770 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 10:37:34.494583 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 10:37:35.034750 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 10:37:35.039868 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 10:37:35.050918 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 10:37:35.099414 tst mo_mt_sms.py: using LAC 40344 10:37:35.219353 tst mo_mt_sms.py: using RAC 54 10:37:35.334692 tst mo_mt_sms.py: using CellId 40344 10:37:35.449377 tst mo_mt_sms.py: using BVCI 40345 10:37:35.554019 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 10:37:35.671440 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 10:37:35.786069 tst mo_mt_sms.py:9: start nitb and bts... 10:37:35.992723 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:37:36.615839 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9019): Launched 10:37:36.921193 run osmo-nitb_10.42.42.2(pid=9020): Launched 10:37:37.091176 run osmo-nitb_10.42.42.2(pid=9020): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9020)] 10:37:37.228914 run osmo-nitb_10.42.42.2(pid=9020): stdout: | (launched: 2022-12-14_10:37:36.865478) 10:37:37.368942 run osmo-nitb_10.42.42.2(pid=9020): stderr: | (launched: 2022-12-14_10:37:36.910859) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:37:37.508077 run osmo-nitb_10.42.42.2(pid=9020): stdout: | (launched: 2022-12-14_10:37:36.865478) 10:37:37.641311 run osmo-nitb_10.42.42.2(pid=9020): stderr: | (launched: 2022-12-14_10:37:36.910859) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9020): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9020) [trial-2403↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9020)] 10:37:38.037202 tst osmo-nitb_10.42.42.2(pid=9020): stdout: | (launched: 2022-12-14_10:37:36.865478) 10:37:38.160076 tst osmo-nitb_10.42.42.2(pid=9020): stderr: | (launched: 2022-12-14_10:37:36.910859) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:37:38.305410 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9020): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9020) [trial-2403↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9020)] [trial-2403↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 10:37:38.314384 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 10:37:38.321551 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9019): Terminating (SIGTERM) 10:37:38.531235 --- ParallelTerminationStrategy: PID 9019 died... 10:37:38.552557 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9019): Terminated: ok {rc=0} 10:37:38.639392 bus /sierra_3: Setting Powered False 10:37:39.737763 bus /sierra_3: Setting Powered False 10:37:40.852690 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 sms:trx-lms --------------------------------------------------------------------- 10:37:42.049939 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:37:42.053769 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 10:37:42.086433 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 10:37:42.113987 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 10:37:42.164234 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 10:37:42.197881 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 10:37:42.227049 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 10:37:42.771194 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 10:37:42.776608 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:37:42.787685 tst sms:trx-lms: Using 1 x bts (candidates: 1) 10:37:42.836723 tst mo_mt_sms.py: using LAC 40345 10:37:42.955654 tst mo_mt_sms.py: using RAC 55 10:37:43.073916 tst mo_mt_sms.py: using CellId 40345 10:37:43.191851 tst mo_mt_sms.py: using BVCI 40346 10:37:43.301351 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:37:43.312229 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:37:43.323028 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:37:43.333782 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:37:43.345870 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:37:43.356558 tst sms:trx-lms: Using 1 x modem (candidates: 2) 10:37:43.471017 tst sms:trx-lms: Using 1 x modem (candidates: 2) 10:37:43.590823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:44.063097 run create_hlr_db(pid=9024): Launched 10:37:44.188053 bus /sierra_2: Setting Powered False 10:37:45.246348 run create_hlr_db(pid=9024): Terminated: ok {rc=0} 10:37:45.673890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9026): Launched 10:37:45.991562 run osmo-hlr_10.42.42.2(pid=9027): Launched 10:37:46.266508 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:46.941775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9029): Launched 10:37:47.265800 run osmo-stp_10.42.42.5(pid=9030): Launched 10:37:47.424090 run osmo-msc_10.42.42.6: Starting osmo-msc 10:37:47.987025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9032): Launched 10:37:48.297783 run osmo-msc_10.42.42.6(pid=9033): Launched 10:37:48.471058 run osmo-stp_10.42.42.5(pid=9030): ERR: Terminated: ERROR {rc=1} [trial-2403↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9030)] 10:37:48.601466 run osmo-stp_10.42.42.5(pid=9030): stdout: | (launched: 2022-12-14_10:37:47.196840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:48.732501 run osmo-stp_10.42.42.5(pid=9030): stderr: | 20221214103747410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103747410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103747411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103747411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103747411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103747412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103747412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:48.863024 run osmo-stp_10.42.42.5(pid=9030): stdout: | (launched: 2022-12-14_10:37:47.196840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:48.987418 run osmo-stp_10.42.42.5(pid=9030): stderr: | 20221214103747410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103747410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103747411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103747411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103747411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103747412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103747412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:49.135601 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9030): Process ended prematurely: osmo-stp_10.42.42.5(pid=9030) [trial-2403↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9030)] [trial-2403↪sms:trx-lms↪mo_mt_sms.py:16] 10:37:49.144824 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 10:37:49.172409 run osmo-hlr_10.42.42.2(pid=9027): ERR: Terminated: ERROR {rc=237} [trial-2403↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9027)] 10:37:49.223050 run osmo-hlr_10.42.42.2(pid=9027): stdout: | (launched: 2022-12-14_10:37:45.933281) 10:37:49.275173 run osmo-hlr_10.42.42.2(pid=9027): stderr: | 20221214103746175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103746175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103746175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103746175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103746175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103746175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103746191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103746205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103746205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103746205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:49.347443 run osmo-msc_10.42.42.6(pid=9033): ERR: Terminated: ERROR {rc=2} [trial-2403↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9033)] 10:37:49.397512 run osmo-msc_10.42.42.6(pid=9033): stdout: | (launched: 2022-12-14_10:37:48.241109) 10:37:49.449313 run osmo-msc_10.42.42.6(pid=9033): stderr: | 20221214103748559 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103748559 DLGLOBAL DEBUG validating counter group 0x7f4c56c3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103748559 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103748559 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103748559 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103748560 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103748561 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103748562 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103748562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103748562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:37:49.501206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9026): Terminating (SIGTERM) 10:37:49.542671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9029): Terminating (SIGTERM) 10:37:49.584253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9032): Terminating (SIGTERM) 10:37:49.626233 --- ParallelTerminationStrategy: PID 9026 died... 10:37:49.646508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9026): Terminated: ok {rc=0} 10:37:49.693178 --- ParallelTerminationStrategy: PID 9029 died... 10:37:49.712934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9029): Terminated: ok {rc=0} 10:37:49.759044 --- ParallelTerminationStrategy: PID 9032 died... 10:37:49.778796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9032): Terminated: ok {rc=0} 10:37:49.866788 bus /sierra_3: Setting Powered False 10:37:50.965237 bus /sierra_3: Setting Powered False 10:37:52.081740 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_ussd:trx-lms --------------------------------------------------------------------- 10:37:53.312854 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:37:53.317041 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 10:37:53.350506 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 10:37:53.358034 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 10:37:53.394164 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 10:37:53.428023 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 10:37:53.435244 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 10:37:53.955137 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2403 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 10:37:53.960379 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 10:37:53.971617 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 10:37:54.020018 tst assert_extension.py: using LAC 40346 10:37:54.141538 tst assert_extension.py: using RAC 56 10:37:54.263081 tst assert_extension.py: using CellId 40346 10:37:54.386650 tst assert_extension.py: using BVCI 40347 10:37:54.500607 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 10:37:54.615509 tst assert_extension.py:10: start nitb and bts... 10:37:54.811990 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:37:55.410886 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9038): Launched 10:37:55.704373 run osmo-nitb_10.42.42.2(pid=9039): Launched 10:37:55.867251 run osmo-nitb_10.42.42.2(pid=9039): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9039)] 10:37:56.000097 run osmo-nitb_10.42.42.2(pid=9039): stdout: | (launched: 2022-12-14_10:37:55.650435) 10:37:56.133973 run osmo-nitb_10.42.42.2(pid=9039): stderr: | (launched: 2022-12-14_10:37:55.693855) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:37:56.267768 run osmo-nitb_10.42.42.2(pid=9039): stdout: | (launched: 2022-12-14_10:37:55.650435) 10:37:56.395669 run osmo-nitb_10.42.42.2(pid=9039): stderr: | (launched: 2022-12-14_10:37:55.693855) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9039): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9039) [trial-2403↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9039)] 10:37:56.815449 tst osmo-nitb_10.42.42.2(pid=9039): stdout: | (launched: 2022-12-14_10:37:55.650435) 10:37:56.933553 tst osmo-nitb_10.42.42.2(pid=9039): stderr: | (launched: 2022-12-14_10:37:55.693855) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:37:57.073635 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9039): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9039) [trial-2403↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9039)] [trial-2403↪nitb_ussd:trx-lms↪assert_extension.py:12] 10:37:57.081966 tst assert_extension.py:12: Test FAILED (3.1 sec) 10:37:57.088532 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9038): Terminating (SIGTERM) 10:37:57.298564 --- ParallelTerminationStrategy: PID 9038 died... 10:37:57.319566 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9038): Terminated: ok {rc=0} 10:37:57.407823 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 ussd:trx-lms --------------------------------------------------------------------- 10:37:58.587063 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:37:58.590854 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 10:37:58.623142 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 10:37:58.653196 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 10:37:58.689789 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 10:37:58.723445 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 10:37:58.750501 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 10:37:59.278702 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2403 ussd:trx-lms assert_extension.py ---------------------------------------------- 10:37:59.284189 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:37:59.295310 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 10:37:59.345397 tst assert_extension.py: using LAC 40347 10:37:59.468452 tst assert_extension.py: using RAC 57 10:37:59.591439 tst assert_extension.py: using CellId 40347 10:37:59.714998 tst assert_extension.py: using BVCI 40348 10:37:59.828054 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:37:59.839202 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:37:59.850097 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:37:59.860927 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:37:59.872410 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:37:59.883940 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 10:37:59.999099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:00.454273 run create_hlr_db(pid=9043): Launched 10:38:00.582617 bus /sierra_2: Setting Powered False 10:38:01.660239 run create_hlr_db(pid=9043): Terminated: ok {rc=0} 10:38:02.163300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9045): Launched 10:38:02.501582 run osmo-hlr_10.42.42.2(pid=9046): Launched 10:38:02.619980 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:03.164531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9048): Launched 10:38:03.475907 run osmo-stp_10.42.42.5(pid=9049): Launched 10:38:03.594698 run osmo-msc_10.42.42.6: Starting osmo-msc 10:38:04.156370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9051): Launched 10:38:04.467648 run osmo-msc_10.42.42.6(pid=9052): Launched 10:38:04.640310 run osmo-stp_10.42.42.5(pid=9049): ERR: Terminated: ERROR {rc=1} [trial-2403↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9049)] 10:38:04.771419 run osmo-stp_10.42.42.5(pid=9049): stdout: | (launched: 2022-12-14_10:38:03.418938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:04.903026 run osmo-stp_10.42.42.5(pid=9049): stderr: | 20221214103803604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103803604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103803604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103803605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103803605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103803605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103803605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:05.034850 run osmo-stp_10.42.42.5(pid=9049): stdout: | (launched: 2022-12-14_10:38:03.418938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:05.158923 run osmo-stp_10.42.42.5(pid=9049): stderr: | 20221214103803604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103803604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103803604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103803605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103803605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103803605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103803605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:05.307072 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9049): Process ended prematurely: osmo-stp_10.42.42.5(pid=9049) [trial-2403↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9049)] [trial-2403↪ussd:trx-lms↪assert_extension.py:17] 10:38:05.316235 tst assert_extension.py:17: Test FAILED (6.0 sec) 10:38:05.343654 run osmo-hlr_10.42.42.2(pid=9046): ERR: Terminated: ERROR {rc=237} [trial-2403↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9046)] 10:38:05.393877 run osmo-hlr_10.42.42.2(pid=9046): stdout: | (launched: 2022-12-14_10:38:02.444488) 10:38:05.446139 run osmo-hlr_10.42.42.2(pid=9046): stderr: | 20221214103802635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103802635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103802636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103802636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103802636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103802636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103802648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103802657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103802658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103802658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:05.519006 run osmo-msc_10.42.42.6(pid=9052): ERR: Terminated: ERROR {rc=2} [trial-2403↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9052)] 10:38:05.569607 run osmo-msc_10.42.42.6(pid=9052): stdout: | (launched: 2022-12-14_10:38:04.410526) 10:38:05.621474 run osmo-msc_10.42.42.6(pid=9052): stderr: | 20221214103804728 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103804728 DLGLOBAL DEBUG validating counter group 0x7f0d9a6c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103804728 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103804728 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103804728 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103804728 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103804730 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103804730 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103804731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103804731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:38:05.673968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9045): Terminating (SIGTERM) 10:38:05.715657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9048): Terminating (SIGTERM) 10:38:05.757561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9051): Terminating (SIGTERM) 10:38:05.799687 --- ParallelTerminationStrategy: PID 9045 died... 10:38:05.819899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9045): Terminated: ok {rc=0} 10:38:05.866699 --- ParallelTerminationStrategy: PID 9048 died... 10:38:05.886356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9048): Terminated: ok {rc=0} 10:38:05.932309 --- ParallelTerminationStrategy: PID 9051 died... 10:38:05.952335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9051): Terminated: ok {rc=0} 10:38:06.040912 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:38:07.254598 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:38:07.261709 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:38:07.295068 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:38:07.323367 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:38:07.379090 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:38:07.412416 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:38:07.438965 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:38:07.988837 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:38:08.041437 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:38:08.053488 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:38:08.124339 tst mo_mt_call.py: using LAC 40348 10:38:08.249768 tst mo_mt_call.py: using RAC 58 10:38:08.377156 tst mo_mt_call.py: using CellId 40348 10:38:08.500392 tst mo_mt_call.py: using BVCI 40349 10:38:08.616745 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:38:08.628231 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:38:08.639522 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:38:08.650805 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:38:08.662735 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:38:08.674513 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:38:08.790239 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:38:08.909990 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:09.402864 run create_hlr_db(pid=9057): Launched 10:38:09.532021 bus /sierra_2: Setting Powered False 10:38:10.591632 run create_hlr_db(pid=9057): Terminated: ok {rc=0} 10:38:11.034982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9059): Launched 10:38:11.353070 run osmo-hlr_10.42.42.2(pid=9060): Launched 10:38:11.473418 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:12.019192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9062): Launched 10:38:12.337885 run osmo-stp_10.42.42.5(pid=9063): Launched 10:38:12.457816 run osmo-msc_10.42.42.6: Starting osmo-msc 10:38:13.030575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9065): Launched 10:38:13.349046 run osmo-msc_10.42.42.6(pid=9066): Launched 10:38:13.525668 run osmo-stp_10.42.42.5(pid=9063): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9063)] 10:38:13.660123 run osmo-stp_10.42.42.5(pid=9063): stdout: | (launched: 2022-12-14_10:38:12.279689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:13.794691 run osmo-stp_10.42.42.5(pid=9063): stderr: | 20221214103812466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103812466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103812466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103812467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103812467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103812467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103812467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:13.927717 run osmo-stp_10.42.42.5(pid=9063): stdout: | (launched: 2022-12-14_10:38:12.279689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:14.054156 run osmo-stp_10.42.42.5(pid=9063): stderr: | 20221214103812466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103812466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103812466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103812467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103812467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103812467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103812467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:14.205461 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9063): Process ended prematurely: osmo-stp_10.42.42.5(pid=9063) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9063)] [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:38:14.215072 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:38:14.243078 run osmo-hlr_10.42.42.2(pid=9060): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9060)] 10:38:14.293542 run osmo-hlr_10.42.42.2(pid=9060): stdout: | (launched: 2022-12-14_10:38:11.295122) 10:38:14.345701 run osmo-hlr_10.42.42.2(pid=9060): stderr: | 20221214103811488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103811488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103811488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103811488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103811488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103811488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103811500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103811510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103811510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103811510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:14.418162 run osmo-msc_10.42.42.6(pid=9066): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9066)] 10:38:14.467945 run osmo-msc_10.42.42.6(pid=9066): stdout: | (launched: 2022-12-14_10:38:13.291053) 10:38:14.519785 run osmo-msc_10.42.42.6(pid=9066): stderr: | 20221214103813607 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103813607 DLGLOBAL DEBUG validating counter group 0x7f0d1265fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103813607 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103813607 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103813607 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103813607 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103813609 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103813610 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103813610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103813610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:38:14.572061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9059): Terminating (SIGTERM) 10:38:14.613976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9062): Terminating (SIGTERM) 10:38:14.655842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9065): Terminating (SIGTERM) 10:38:14.697868 --- ParallelTerminationStrategy: PID 9059 died... 10:38:14.718126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9059): Terminated: ok {rc=0} 10:38:14.764520 --- ParallelTerminationStrategy: PID 9062 died... 10:38:14.784281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9062): Terminated: ok {rc=0} 10:38:14.830891 --- ParallelTerminationStrategy: PID 9065 died... 10:38:14.850892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9065): Terminated: ok {rc=0} 10:38:14.939551 bus /sierra_3: Setting Powered False 10:38:16.037774 bus /sierra_3: Setting Powered False 10:38:17.165920 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:38:18.313363 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:38:18.324999 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:38:18.394260 tst mo_mt_call_osmux.py: using LAC 40349 10:38:18.513600 tst mo_mt_call_osmux.py: using RAC 59 10:38:18.632637 tst mo_mt_call_osmux.py: using CellId 40349 10:38:18.752757 tst mo_mt_call_osmux.py: using BVCI 40350 10:38:18.862520 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:38:18.873500 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:38:18.884127 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:38:18.894970 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:38:18.906105 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:38:18.917145 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:38:19.032895 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:38:19.155187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:19.651401 run create_hlr_db(pid=9068): Launched 10:38:19.782568 bus /sierra_2: Setting Powered False 10:38:20.845958 run create_hlr_db(pid=9068): Terminated: ok {rc=0} 10:38:21.291020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9070): Launched 10:38:21.610208 run osmo-hlr_10.42.42.2(pid=9071): Launched 10:38:21.731957 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:22.283363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9073): Launched 10:38:22.601193 run osmo-stp_10.42.42.5(pid=9074): Launched 10:38:22.722130 run osmo-msc_10.42.42.6: Starting osmo-msc 10:38:23.297242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9076): Launched 10:38:23.614875 run osmo-msc_10.42.42.6(pid=9077): Launched 10:38:23.793140 run osmo-stp_10.42.42.5(pid=9074): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9074)] 10:38:23.926655 run osmo-stp_10.42.42.5(pid=9074): stdout: | (launched: 2022-12-14_10:38:22.543370) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:24.061782 run osmo-stp_10.42.42.5(pid=9074): stderr: | 20221214103822730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103822731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103822731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103822732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103822732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103822732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103822732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:24.195029 run osmo-stp_10.42.42.5(pid=9074): stdout: | (launched: 2022-12-14_10:38:22.543370) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:24.321792 run osmo-stp_10.42.42.5(pid=9074): stderr: | 20221214103822730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103822731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103822731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103822732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103822732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103822732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103822732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:24.473050 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9074): Process ended prematurely: osmo-stp_10.42.42.5(pid=9074) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9074)] [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:38:24.482875 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:38:24.510986 run osmo-hlr_10.42.42.2(pid=9071): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9071)] 10:38:24.561406 run osmo-hlr_10.42.42.2(pid=9071): stdout: | (launched: 2022-12-14_10:38:21.552520) 10:38:24.613466 run osmo-hlr_10.42.42.2(pid=9071): stderr: | 20221214103821745 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103821745 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103821745 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103821745 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103821745 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103821745 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103821758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103821768 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103821768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103821768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:24.686052 run osmo-msc_10.42.42.6(pid=9077): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9077)] 10:38:24.736075 run osmo-msc_10.42.42.6(pid=9077): stdout: | (launched: 2022-12-14_10:38:23.557188) 10:38:24.787901 run osmo-msc_10.42.42.6(pid=9077): stderr: | 20221214103823873 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103823873 DLGLOBAL DEBUG validating counter group 0x7f6336138c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103823873 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103823874 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103823874 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103823874 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103823876 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103823876 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103823876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103823876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:38:24.840492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9070): Terminating (SIGTERM) 10:38:24.882428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9073): Terminating (SIGTERM) 10:38:24.924246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9076): Terminating (SIGTERM) 10:38:24.966910 --- ParallelTerminationStrategy: PID 9070 died... 10:38:24.987294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9070): Terminated: ok {rc=0} 10:38:25.033952 --- ParallelTerminationStrategy: PID 9073 died... 10:38:25.053658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9073): Terminated: ok {rc=0} 10:38:25.099851 --- ParallelTerminationStrategy: PID 9076 died... 10:38:25.119623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9076): Terminated: ok {rc=0} 10:38:25.207840 bus /sierra_3: Setting Powered False 10:38:26.307266 bus /sierra_3: Setting Powered False 10:38:27.426879 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:38:28.676162 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:38:28.684111 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:38:28.717715 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:38:28.744312 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:38:28.796420 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:38:28.830176 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:38:28.857471 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:38:29.404354 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:38:29.452764 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:38:29.463960 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:38:29.532608 tst mo_mt_call.py: using LAC 40350 10:38:29.649381 tst mo_mt_call.py: using RAC 60 10:38:29.765897 tst mo_mt_call.py: using CellId 40350 10:38:29.888000 tst mo_mt_call.py: using BVCI 40351 10:38:29.995544 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:38:30.006606 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:38:30.017532 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:38:30.028311 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:38:30.039513 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:38:30.050607 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:38:30.169870 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:38:30.288434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:30.779760 run create_hlr_db(pid=9082): Launched 10:38:30.922204 bus /sierra_2: Setting Powered False 10:38:31.981011 run create_hlr_db(pid=9082): Terminated: ok {rc=0} 10:38:32.450303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9084): Launched 10:38:32.767408 run osmo-hlr_10.42.42.2(pid=9085): Launched 10:38:32.887212 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:33.437333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9087): Launched 10:38:33.754705 run osmo-stp_10.42.42.5(pid=9088): Launched 10:38:33.875110 run osmo-msc_10.42.42.6: Starting osmo-msc 10:38:34.448820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9090): Launched 10:38:34.766130 run osmo-msc_10.42.42.6(pid=9091): Launched 10:38:34.942403 run osmo-stp_10.42.42.5(pid=9088): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9088)] 10:38:35.076604 run osmo-stp_10.42.42.5(pid=9088): stdout: | (launched: 2022-12-14_10:38:33.696791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:35.211099 run osmo-stp_10.42.42.5(pid=9088): stderr: | 20221214103833884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103833884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103833884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103833885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103833885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103833885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103833885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:35.343684 run osmo-stp_10.42.42.5(pid=9088): stdout: | (launched: 2022-12-14_10:38:33.696791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:35.469516 run osmo-stp_10.42.42.5(pid=9088): stderr: | 20221214103833884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103833884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103833884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103833885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103833885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103833885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103833885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:35.620459 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9088): Process ended prematurely: osmo-stp_10.42.42.5(pid=9088) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9088)] [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:38:35.630056 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:38:35.657644 run osmo-hlr_10.42.42.2(pid=9085): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9085)] 10:38:35.707756 run osmo-hlr_10.42.42.2(pid=9085): stdout: | (launched: 2022-12-14_10:38:32.709794) 10:38:35.759545 run osmo-hlr_10.42.42.2(pid=9085): stderr: | 20221214103832901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103832901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103832901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103832901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103832901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103832901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103832914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103832922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103832922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103832922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:35.831925 run osmo-msc_10.42.42.6(pid=9091): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9091)] 10:38:35.881592 run osmo-msc_10.42.42.6(pid=9091): stdout: | (launched: 2022-12-14_10:38:34.708302) 10:38:35.933231 run osmo-msc_10.42.42.6(pid=9091): stderr: | 20221214103835024 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103835024 DLGLOBAL DEBUG validating counter group 0x7f107cc60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103835024 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103835024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103835025 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103835025 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103835026 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103835027 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103835027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103835027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:38:35.985636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9084): Terminating (SIGTERM) 10:38:36.027563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9087): Terminating (SIGTERM) 10:38:36.069562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9090): Terminating (SIGTERM) 10:38:36.111659 --- ParallelTerminationStrategy: PID 9084 died... 10:38:36.131431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9084): Terminated: ok {rc=0} 10:38:36.177660 --- ParallelTerminationStrategy: PID 9087 died... 10:38:36.197162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9087): Terminated: ok {rc=0} 10:38:36.243633 --- ParallelTerminationStrategy: PID 9090 died... 10:38:36.263119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9090): Terminated: ok {rc=0} 10:38:36.350349 bus /sierra_3: Setting Powered False 10:38:37.448835 bus /sierra_3: Setting Powered False 10:38:38.563577 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:38:39.708821 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:38:39.720376 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:38:39.790140 tst mo_mt_call_osmux.py: using LAC 40351 10:38:39.915988 tst mo_mt_call_osmux.py: using RAC 61 10:38:40.043018 tst mo_mt_call_osmux.py: using CellId 40351 10:38:40.168416 tst mo_mt_call_osmux.py: using BVCI 40352 10:38:40.277643 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:38:40.288593 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:38:40.299611 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:38:40.310635 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:38:40.321804 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:38:40.332862 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:38:40.448574 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:38:40.567906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:41.061768 run create_hlr_db(pid=9093): Launched 10:38:41.191517 bus /sierra_2: Setting Powered False 10:38:42.254254 run create_hlr_db(pid=9093): Terminated: ok {rc=0} 10:38:42.682087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9095): Launched 10:38:42.981403 run osmo-hlr_10.42.42.2(pid=9096): Launched 10:38:43.096602 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:43.621613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9098): Launched 10:38:43.921741 run osmo-stp_10.42.42.5(pid=9099): Launched 10:38:44.034994 run osmo-msc_10.42.42.6: Starting osmo-msc 10:38:44.586815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9101): Launched 10:38:44.886002 run osmo-msc_10.42.42.6(pid=9102): Launched 10:38:45.053149 run osmo-stp_10.42.42.5(pid=9099): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9099)] 10:38:45.180724 run osmo-stp_10.42.42.5(pid=9099): stdout: | (launched: 2022-12-14_10:38:43.867209) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:45.308061 run osmo-stp_10.42.42.5(pid=9099): stderr: | 20221214103844033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103844033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103844033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103844034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103844034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103844034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103844034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:45.433496 run osmo-stp_10.42.42.5(pid=9099): stdout: | (launched: 2022-12-14_10:38:43.867209) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:45.552874 run osmo-stp_10.42.42.5(pid=9099): stderr: | 20221214103844033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103844033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103844033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103844034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103844034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103844034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103844034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:45.695072 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9099): Process ended prematurely: osmo-stp_10.42.42.5(pid=9099) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9099)] [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:38:45.704240 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 10:38:45.731053 run osmo-hlr_10.42.42.2(pid=9096): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9096)] 10:38:45.779770 run osmo-hlr_10.42.42.2(pid=9096): stdout: | (launched: 2022-12-14_10:38:42.926848) 10:38:45.841952 run osmo-hlr_10.42.42.2(pid=9096): stderr: | 20221214103843100 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103843100 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103843100 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103843100 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103843100 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103843100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103843112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103843122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103843123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103843123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:45.921952 run osmo-msc_10.42.42.6(pid=9102): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9102)] 10:38:45.970707 run osmo-msc_10.42.42.6(pid=9102): stdout: | (launched: 2022-12-14_10:38:44.831313) 10:38:46.021812 run osmo-msc_10.42.42.6(pid=9102): stderr: | 20221214103845098 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103845098 DLGLOBAL DEBUG validating counter group 0x7f1e4fb3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103845098 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103845098 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103845098 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103845099 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103845101 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103845101 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103845101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103845101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:38:46.075873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9095): Terminating (SIGTERM) 10:38:46.118001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9098): Terminating (SIGTERM) 10:38:46.162421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9101): Terminating (SIGTERM) 10:38:46.206791 --- ParallelTerminationStrategy: PID 9095 died... 10:38:46.228057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9095): Terminated: ok {rc=0} 10:38:46.274887 --- ParallelTerminationStrategy: PID 9098 died... 10:38:46.295981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9098): Terminated: ok {rc=0} 10:38:46.343270 --- ParallelTerminationStrategy: PID 9101 died... 10:38:46.364027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9101): Terminated: ok {rc=0} 10:38:46.460135 bus /sierra_3: Setting Powered False 10:38:47.572384 bus /sierra_3: Setting Powered False 10:38:48.689468 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:38:49.942779 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:38:49.949933 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:38:49.983860 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:38:50.011780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:38:50.064360 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:38:50.097075 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:38:50.123801 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:38:50.678942 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:38:50.729812 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:38:50.741512 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:38:50.811592 tst mo_mt_call.py: using LAC 40352 10:38:50.928679 tst mo_mt_call.py: using RAC 62 10:38:51.047865 tst mo_mt_call.py: using CellId 40352 10:38:51.164646 tst mo_mt_call.py: using BVCI 40353 10:38:51.272512 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:38:51.283666 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:38:51.294672 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:38:51.305551 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:38:51.316689 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:38:51.328016 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:38:51.447482 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:38:51.568482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:52.032193 run create_hlr_db(pid=9107): Launched 10:38:52.146475 bus /sierra_2: Setting Powered False 10:38:53.206155 run create_hlr_db(pid=9107): Terminated: ok {rc=0} 10:38:53.643434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9109): Launched 10:38:53.962182 run osmo-hlr_10.42.42.2(pid=9110): Launched 10:38:54.084547 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:54.629834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9112): Launched 10:38:54.947571 run osmo-stp_10.42.42.5(pid=9113): Launched 10:38:55.070998 run osmo-msc_10.42.42.6: Starting osmo-msc 10:38:55.645058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9115): Launched 10:38:55.962071 run osmo-msc_10.42.42.6(pid=9116): Launched 10:38:56.139327 run osmo-stp_10.42.42.5(pid=9113): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9113)] 10:38:56.272891 run osmo-stp_10.42.42.5(pid=9113): stdout: | (launched: 2022-12-14_10:38:54.889948) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:56.407439 run osmo-stp_10.42.42.5(pid=9113): stderr: | 20221214103855077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103855077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103855077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103855078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103855078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103855078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103855078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:56.540910 run osmo-stp_10.42.42.5(pid=9113): stdout: | (launched: 2022-12-14_10:38:54.889948) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:56.667384 run osmo-stp_10.42.42.5(pid=9113): stderr: | 20221214103855077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103855077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103855077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103855078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103855078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103855078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103855078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:56.818863 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9113): Process ended prematurely: osmo-stp_10.42.42.5(pid=9113) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9113)] [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:38:56.828466 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:38:56.856299 run osmo-hlr_10.42.42.2(pid=9110): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9110)] 10:38:56.906650 run osmo-hlr_10.42.42.2(pid=9110): stdout: | (launched: 2022-12-14_10:38:53.904109) 10:38:56.958572 run osmo-hlr_10.42.42.2(pid=9110): stderr: | 20221214103854096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103854096 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103854096 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103854096 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103854096 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103854096 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103854108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103854117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103854117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103854117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:57.031363 run osmo-msc_10.42.42.6(pid=9116): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9116)] 10:38:57.081309 run osmo-msc_10.42.42.6(pid=9116): stdout: | (launched: 2022-12-14_10:38:55.904078) 10:38:57.133057 run osmo-msc_10.42.42.6(pid=9116): stderr: | 20221214103856221 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103856221 DLGLOBAL DEBUG validating counter group 0x7f1184d8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103856221 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103856221 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103856222 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103856222 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103856223 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103856224 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103856224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103856224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:38:57.184877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9109): Terminating (SIGTERM) 10:38:57.226610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9112): Terminating (SIGTERM) 10:38:57.268901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9115): Terminating (SIGTERM) 10:38:57.311060 --- ParallelTerminationStrategy: PID 9109 died... 10:38:57.331130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9109): Terminated: ok {rc=0} 10:38:57.377198 --- ParallelTerminationStrategy: PID 9112 died... 10:38:57.396596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9112): Terminated: ok {rc=0} 10:38:57.442378 --- ParallelTerminationStrategy: PID 9115 died... 10:38:57.462028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9115): Terminated: ok {rc=0} 10:38:57.549613 bus /sierra_3: Setting Powered False 10:38:58.648003 bus /sierra_3: Setting Powered False 10:38:59.766174 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:39:00.928476 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:39:00.941269 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:39:01.018611 tst mo_mt_call_osmux.py: using LAC 40353 10:39:01.175803 tst mo_mt_call_osmux.py: using RAC 63 10:39:01.322285 tst mo_mt_call_osmux.py: using CellId 40353 10:39:01.461343 tst mo_mt_call_osmux.py: using BVCI 40354 10:39:01.603794 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:39:01.618709 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:39:01.640922 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:39:01.656287 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:39:01.678154 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:39:01.696640 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:39:01.844211 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:39:01.987645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:02.522697 run create_hlr_db(pid=9166): Launched 10:39:02.707659 bus /sierra_2: Setting Powered False 10:39:03.799401 run create_hlr_db(pid=9166): Terminated: ok {rc=0} 10:39:04.298407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9390): Launched 10:39:04.618162 run osmo-hlr_10.42.42.2(pid=9391): Launched 10:39:04.854387 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:05.557476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9393): Launched 10:39:05.881393 run osmo-stp_10.42.42.5(pid=9394): Launched 10:39:06.127015 run osmo-msc_10.42.42.6: Starting osmo-msc 10:39:06.745737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9398): Launched 10:39:07.066313 run osmo-msc_10.42.42.6(pid=9399): Launched 10:39:07.416437 run osmo-stp_10.42.42.5(pid=9394): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9394)] 10:39:07.697772 run osmo-stp_10.42.42.5(pid=9394): stdout: | (launched: 2022-12-14_10:39:05.821871) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:07.981262 run osmo-stp_10.42.42.5(pid=9394): stderr: | 20221214103906110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103906110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103906110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103906111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103906111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103906111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103906111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:08.122820 run osmo-stp_10.42.42.5(pid=9394): stdout: | (launched: 2022-12-14_10:39:05.821871) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:08.247973 run osmo-stp_10.42.42.5(pid=9394): stderr: | 20221214103906110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103906110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103906110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103906111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103906111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103906111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103906111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:08.397333 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9394): Process ended prematurely: osmo-stp_10.42.42.5(pid=9394) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9394)] [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:39:08.407359 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 10:39:08.435603 run osmo-hlr_10.42.42.2(pid=9391): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9391)] 10:39:08.489753 run osmo-hlr_10.42.42.2(pid=9391): stdout: | (launched: 2022-12-14_10:39:04.562805) 10:39:08.542297 run osmo-hlr_10.42.42.2(pid=9391): stderr: | 20221214103904890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103904890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103904890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103904890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103904890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103904890 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103904909 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103904925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103904925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103904925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:08.614942 run osmo-msc_10.42.42.6(pid=9399): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9399)] 10:39:08.667193 run osmo-msc_10.42.42.6(pid=9399): stdout: | (launched: 2022-12-14_10:39:07.007732) 10:39:08.719671 run osmo-msc_10.42.42.6(pid=9399): stderr: | 20221214103907597 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103907598 DLGLOBAL DEBUG validating counter group 0x7faf3a9f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103907598 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103907598 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103907598 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103907598 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103907600 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103907600 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103907600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103907601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:39:08.772583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9390): Terminating (SIGTERM) 10:39:08.815365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9393): Terminating (SIGTERM) 10:39:08.861548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9398): Terminating (SIGTERM) 10:39:08.906728 --- ParallelTerminationStrategy: PID 9390 died... 10:39:08.927173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9390): Terminated: ok {rc=0} 10:39:08.974644 --- ParallelTerminationStrategy: PID 9393 died... 10:39:08.994886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9393): Terminated: ok {rc=0} 10:39:09.044750 --- ParallelTerminationStrategy: PID 9398 died... 10:39:09.066836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9398): Terminated: ok {rc=0} 10:39:09.158560 bus /sierra_3: Setting Powered False 10:39:10.262203 bus /sierra_3: Setting Powered False 10:39:11.379531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:39:12.636221 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:39:12.643870 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:39:12.679955 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:39:12.709309 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:39:12.762538 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:39:12.797505 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:39:12.826138 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:39:13.376478 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:39:13.430863 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:39:13.443419 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:39:13.516310 tst mo_mt_call.py: using LAC 40354 10:39:13.645571 tst mo_mt_call.py: using RAC 64 10:39:13.774821 tst mo_mt_call.py: using CellId 40354 10:39:13.909897 tst mo_mt_call.py: using BVCI 40355 10:39:14.029933 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:39:14.042529 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:39:14.055967 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:39:14.068712 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:39:14.082211 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:39:14.095274 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:39:14.220410 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:39:14.343183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:14.855743 run create_hlr_db(pid=9405): Launched 10:39:15.023982 bus /sierra_2: Setting Powered False 10:39:16.134718 run create_hlr_db(pid=9405): Terminated: ok {rc=0} 10:39:16.685698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9407): Launched 10:39:17.016341 run osmo-hlr_10.42.42.2(pid=9408): Launched 10:39:17.267906 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:18.066618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9410): Launched 10:39:18.407943 run osmo-stp_10.42.42.5(pid=9411): Launched 10:39:18.652423 run osmo-msc_10.42.42.6: Starting osmo-msc 10:39:19.326321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9413): Launched 10:39:19.666559 run osmo-msc_10.42.42.6(pid=9414): Launched 10:39:20.035709 run osmo-stp_10.42.42.5(pid=9411): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9411)] 10:39:20.318228 run osmo-stp_10.42.42.5(pid=9411): stdout: | (launched: 2022-12-14_10:39:18.348541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:20.487454 run osmo-stp_10.42.42.5(pid=9411): stderr: | 20221214103918636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103918636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103918637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103918637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103918638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103918638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103918638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:20.628628 run osmo-stp_10.42.42.5(pid=9411): stdout: | (launched: 2022-12-14_10:39:18.348541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:20.761333 run osmo-stp_10.42.42.5(pid=9411): stderr: | 20221214103918636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103918636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103918637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103918637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103918638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103918638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103918638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:20.918170 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9411): Process ended prematurely: osmo-stp_10.42.42.5(pid=9411) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9411)] [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:39:20.928003 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 10:39:20.957435 run osmo-hlr_10.42.42.2(pid=9408): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9408)] 10:39:21.009963 run osmo-hlr_10.42.42.2(pid=9408): stdout: | (launched: 2022-12-14_10:39:16.956373) 10:39:21.063477 run osmo-hlr_10.42.42.2(pid=9408): stderr: | 20221214103917256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103917256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103917256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103917256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103917256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103917256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103917279 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103917287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103917288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103917288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:21.139399 run osmo-msc_10.42.42.6(pid=9414): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9414)] 10:39:21.191486 run osmo-msc_10.42.42.6(pid=9414): stdout: | (launched: 2022-12-14_10:39:19.607169) 10:39:21.245827 run osmo-msc_10.42.42.6(pid=9414): stderr: | 20221214103920106 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103920106 DLGLOBAL DEBUG validating counter group 0x7f90dad5fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103920106 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103920106 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103920107 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103920109 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103920111 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103920111 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103920111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103920111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:39:21.302223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9407): Terminating (SIGTERM) 10:39:21.346763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9410): Terminating (SIGTERM) 10:39:21.392686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9413): Terminating (SIGTERM) 10:39:21.438926 --- ParallelTerminationStrategy: PID 9407 died... 10:39:21.460641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9407): Terminated: ok {rc=0} 10:39:21.511091 --- ParallelTerminationStrategy: PID 9410 died... 10:39:21.532463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9410): Terminated: ok {rc=0} 10:39:21.581393 --- ParallelTerminationStrategy: PID 9413 died... 10:39:21.602970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9413): Terminated: ok {rc=0} 10:39:21.696520 bus /sierra_3: Setting Powered False 10:39:22.800708 bus /sierra_3: Setting Powered False 10:39:23.920493 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:39:25.072526 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:39:25.084933 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:39:25.156430 tst mo_mt_call_osmux.py: using LAC 40355 10:39:25.282670 tst mo_mt_call_osmux.py: using RAC 65 10:39:25.410867 tst mo_mt_call_osmux.py: using CellId 40355 10:39:25.538601 tst mo_mt_call_osmux.py: using BVCI 40356 10:39:25.657073 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:39:25.668922 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:39:25.680416 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:39:25.691945 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:39:25.703515 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:39:25.714904 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:39:25.831343 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:39:25.950056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:26.450955 run create_hlr_db(pid=9416): Launched 10:39:26.583867 bus /sierra_2: Setting Powered False 10:39:27.647050 run create_hlr_db(pid=9416): Terminated: ok {rc=0} 10:39:28.081158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9418): Launched 10:39:28.386678 run osmo-hlr_10.42.42.2(pid=9419): Launched 10:39:28.504138 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:29.037501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9421): Launched 10:39:29.342006 run osmo-stp_10.42.42.5(pid=9422): Launched 10:39:29.457335 run osmo-msc_10.42.42.6: Starting osmo-msc 10:39:30.005753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9424): Launched 10:39:30.310989 run osmo-msc_10.42.42.6(pid=9425): Launched 10:39:30.481554 run osmo-stp_10.42.42.5(pid=9422): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9422)] 10:39:30.610917 run osmo-stp_10.42.42.5(pid=9422): stdout: | (launched: 2022-12-14_10:39:29.286440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:30.739670 run osmo-stp_10.42.42.5(pid=9422): stderr: | 20221214103929453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103929453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103929453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103929454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103929454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103929454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103929454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:30.887641 run osmo-stp_10.42.42.5(pid=9422): stdout: | (launched: 2022-12-14_10:39:29.286440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:31.022371 run osmo-stp_10.42.42.5(pid=9422): stderr: | 20221214103929453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103929453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103929453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103929454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103929454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103929454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103929454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:31.182760 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9422): Process ended prematurely: osmo-stp_10.42.42.5(pid=9422) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9422)] [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:39:31.194847 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:39:31.225308 run osmo-hlr_10.42.42.2(pid=9419): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9419)] 10:39:31.281936 run osmo-hlr_10.42.42.2(pid=9419): stdout: | (launched: 2022-12-14_10:39:28.330885) 10:39:31.337376 run osmo-hlr_10.42.42.2(pid=9419): stderr: | 20221214103928503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103928503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103928503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103928503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103928503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103928503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103928516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103928524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103928524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103928524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:31.414340 run osmo-msc_10.42.42.6(pid=9425): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9425)] 10:39:31.467330 run osmo-msc_10.42.42.6(pid=9425): stdout: | (launched: 2022-12-14_10:39:30.254444) 10:39:31.523923 run osmo-msc_10.42.42.6(pid=9425): stderr: | 20221214103930523 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103930523 DLGLOBAL DEBUG validating counter group 0x7fce69c33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103930523 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103930523 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103930523 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103930524 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103930525 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103930526 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103930526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103930526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:39:31.579828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9418): Terminating (SIGTERM) 10:39:31.624632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9421): Terminating (SIGTERM) 10:39:31.672255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9424): Terminating (SIGTERM) 10:39:31.719187 --- ParallelTerminationStrategy: PID 9418 died... 10:39:31.741515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9418): Terminated: ok {rc=0} 10:39:31.792723 --- ParallelTerminationStrategy: PID 9421 died... 10:39:31.813550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9421): Terminated: ok {rc=0} 10:39:31.862834 --- ParallelTerminationStrategy: PID 9424 died... 10:39:31.885853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9424): Terminated: ok {rc=0} 10:39:31.978803 bus /sierra_3: Setting Powered False 10:39:33.075168 bus /sierra_3: Setting Powered False 10:39:34.191985 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:39:35.445957 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:39:35.452322 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:39:35.484627 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:39:35.511607 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:39:35.563477 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:39:35.597533 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:39:35.625640 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:39:36.172133 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:39:36.223410 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:39:36.234850 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:39:36.305311 tst mo_mt_call.py: using LAC 40356 10:39:36.426650 tst mo_mt_call.py: using RAC 66 10:39:36.546957 tst mo_mt_call.py: using CellId 40356 10:39:36.668016 tst mo_mt_call.py: using BVCI 40357 10:39:36.779207 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:39:36.790219 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:39:36.801014 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:39:36.811758 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:39:36.823063 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:39:36.834245 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:39:36.955617 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:39:37.073715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:37.545188 run create_hlr_db(pid=9431): Launched 10:39:37.661372 bus /sierra_2: Setting Powered False 10:39:38.721583 run create_hlr_db(pid=9431): Terminated: ok {rc=0} 10:39:39.165541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9433): Launched 10:39:39.490146 run osmo-hlr_10.42.42.2(pid=9434): Launched 10:39:39.615363 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:40.170863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9436): Launched 10:39:40.495503 run osmo-stp_10.42.42.5(pid=9437): Launched 10:39:40.619248 run osmo-msc_10.42.42.6: Starting osmo-msc 10:39:41.204520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9439): Launched 10:39:41.526866 run osmo-msc_10.42.42.6(pid=9440): Launched 10:39:41.706186 run osmo-stp_10.42.42.5(pid=9437): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9437)] 10:39:41.841676 run osmo-stp_10.42.42.5(pid=9437): stdout: | (launched: 2022-12-14_10:39:40.436455) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:41.977481 run osmo-stp_10.42.42.5(pid=9437): stderr: | 20221214103940626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103940626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103940626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103940626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103940627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103940627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103940627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:42.112686 run osmo-stp_10.42.42.5(pid=9437): stdout: | (launched: 2022-12-14_10:39:40.436455) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:42.240351 run osmo-stp_10.42.42.5(pid=9437): stderr: | 20221214103940626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103940626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103940626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103940626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103940627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103940627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103940627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:42.394094 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9437): Process ended prematurely: osmo-stp_10.42.42.5(pid=9437) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9437)] [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:39:42.403837 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:39:42.431908 run osmo-hlr_10.42.42.2(pid=9434): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9434)] 10:39:42.482471 run osmo-hlr_10.42.42.2(pid=9434): stdout: | (launched: 2022-12-14_10:39:39.431471) 10:39:42.534762 run osmo-hlr_10.42.42.2(pid=9434): stderr: | 20221214103939625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103939625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103939625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103939625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103939625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103939626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103939637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103939646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103939646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103939646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:42.607478 run osmo-msc_10.42.42.6(pid=9440): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9440)] 10:39:42.657896 run osmo-msc_10.42.42.6(pid=9440): stdout: | (launched: 2022-12-14_10:39:41.468037) 10:39:42.710091 run osmo-msc_10.42.42.6(pid=9440): stderr: | 20221214103941787 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103941787 DLGLOBAL DEBUG validating counter group 0x7f8f5a016c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103941787 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103941787 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103941787 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103941788 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103941789 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103941790 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103941790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103941790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:39:42.762740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9433): Terminating (SIGTERM) 10:39:42.804872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9436): Terminating (SIGTERM) 10:39:42.846915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9439): Terminating (SIGTERM) 10:39:42.889690 --- ParallelTerminationStrategy: PID 9433 died... 10:39:42.909782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9433): Terminated: ok {rc=0} 10:39:42.955991 --- ParallelTerminationStrategy: PID 9436 died... 10:39:42.975597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9436): Terminated: ok {rc=0} 10:39:43.022517 --- ParallelTerminationStrategy: PID 9439 died... 10:39:43.042751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9439): Terminated: ok {rc=0} 10:39:43.130835 bus /sierra_3: Setting Powered False 10:39:44.229763 bus /sierra_3: Setting Powered False 10:39:45.347902 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:39:46.532815 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:39:46.546380 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:39:46.625278 tst mo_mt_call_osmux.py: using LAC 40357 10:39:46.770051 tst mo_mt_call_osmux.py: using RAC 67 10:39:46.904588 tst mo_mt_call_osmux.py: using CellId 40357 10:39:47.060543 tst mo_mt_call_osmux.py: using BVCI 40358 10:39:47.203514 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:39:47.216405 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:39:47.228685 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:39:47.240615 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:39:47.253859 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:39:47.266991 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:39:47.390163 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:39:47.508067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:47.977345 run create_hlr_db(pid=9442): Launched 10:39:48.094704 bus /sierra_2: Setting Powered False 10:39:49.154776 run create_hlr_db(pid=9442): Terminated: ok {rc=0} 10:39:49.577210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9444): Launched 10:39:49.879410 run osmo-hlr_10.42.42.2(pid=9445): Launched 10:39:49.995132 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:50.514042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9447): Launched 10:39:50.816819 run osmo-stp_10.42.42.5(pid=9448): Launched 10:39:50.933222 run osmo-msc_10.42.42.6: Starting osmo-msc 10:39:51.479439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9450): Launched 10:39:51.782148 run osmo-msc_10.42.42.6(pid=9451): Launched 10:39:51.952373 run osmo-stp_10.42.42.5(pid=9448): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9448)] 10:39:52.080804 run osmo-stp_10.42.42.5(pid=9448): stdout: | (launched: 2022-12-14_10:39:50.761482) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:52.209319 run osmo-stp_10.42.42.5(pid=9448): stderr: | 20221214103950928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103950928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103950928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103950929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103950929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103950930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103950930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:52.335392 run osmo-stp_10.42.42.5(pid=9448): stdout: | (launched: 2022-12-14_10:39:50.761482) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:52.455929 run osmo-stp_10.42.42.5(pid=9448): stderr: | 20221214103950928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214103950928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214103950928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214103950929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214103950929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214103950930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214103950930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:52.599716 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9448): Process ended prematurely: osmo-stp_10.42.42.5(pid=9448) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9448)] [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:39:52.608921 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:39:52.635655 run osmo-hlr_10.42.42.2(pid=9445): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9445)] 10:39:52.684188 run osmo-hlr_10.42.42.2(pid=9445): stdout: | (launched: 2022-12-14_10:39:49.824409) 10:39:52.734138 run osmo-hlr_10.42.42.2(pid=9445): stderr: | 20221214103949994 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214103949995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214103949995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214103949995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214103949995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214103949995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214103950007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214103950017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214103950018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214103950018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:52.804039 run osmo-msc_10.42.42.6(pid=9451): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9451)] 10:39:52.851945 run osmo-msc_10.42.42.6(pid=9451): stdout: | (launched: 2022-12-14_10:39:51.726645) 10:39:52.901878 run osmo-msc_10.42.42.6(pid=9451): stderr: | 20221214103951995 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214103951995 DLGLOBAL DEBUG validating counter group 0x7f7846c89c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214103951995 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214103951995 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214103951995 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214103951996 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214103951997 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214103951998 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214103951998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214103951998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:39:52.952069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9444): Terminating (SIGTERM) 10:39:52.992564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9447): Terminating (SIGTERM) 10:39:53.032642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9450): Terminating (SIGTERM) 10:39:53.073124 --- ParallelTerminationStrategy: PID 9444 died... 10:39:53.092858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9444): Terminated: ok {rc=0} 10:39:53.137351 --- ParallelTerminationStrategy: PID 9447 died... 10:39:53.156477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9447): Terminated: ok {rc=0} 10:39:53.200403 --- ParallelTerminationStrategy: PID 9450 died... 10:39:53.219437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9450): Terminated: ok {rc=0} 10:39:53.306283 bus /sierra_3: Setting Powered False 10:39:54.407128 bus /sierra_3: Setting Powered False 10:39:55.522496 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:39:56.776501 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:39:56.783110 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:39:56.815858 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:39:56.843236 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:39:56.895712 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:39:56.928562 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:39:56.955167 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:39:57.504738 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:39:57.554222 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:39:57.565529 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:39:57.638182 tst mo_mt_call.py: using LAC 40358 10:39:57.756878 tst mo_mt_call.py: using RAC 68 10:39:57.874132 tst mo_mt_call.py: using CellId 40358 10:39:57.993084 tst mo_mt_call.py: using BVCI 40359 10:39:58.103099 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:39:58.114355 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:39:58.125476 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:39:58.136447 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:39:58.147935 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:39:58.159406 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:39:58.280632 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:39:58.398973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:58.870791 run create_hlr_db(pid=9456): Launched 10:39:58.987566 bus /sierra_2: Setting Powered False 10:40:00.049240 run create_hlr_db(pid=9456): Terminated: ok {rc=0} 10:40:00.495228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9458): Launched 10:40:00.819482 run osmo-hlr_10.42.42.2(pid=9459): Launched 10:40:01.119667 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:01.788552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9464): Launched 10:40:02.170271 run osmo-stp_10.42.42.5(pid=9465): Launched 10:40:02.450067 run osmo-msc_10.42.42.6: Starting osmo-msc 10:40:03.035482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9467): Launched 10:40:03.359086 run osmo-msc_10.42.42.6(pid=9468): Launched 10:40:03.539867 run osmo-stp_10.42.42.5(pid=9465): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9465)] 10:40:03.675439 run osmo-stp_10.42.42.5(pid=9465): stdout: | (launched: 2022-12-14_10:40:02.113560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:03.811074 run osmo-stp_10.42.42.5(pid=9465): stderr: | 20221214104002310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104002310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104002310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104002311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104002311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104002311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104002311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:03.946869 run osmo-stp_10.42.42.5(pid=9465): stdout: | (launched: 2022-12-14_10:40:02.113560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:04.075850 run osmo-stp_10.42.42.5(pid=9465): stderr: | 20221214104002310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104002310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104002310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104002311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104002311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104002311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104002311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:04.229961 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9465): Process ended prematurely: osmo-stp_10.42.42.5(pid=9465) [trial-2403↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9465)] [trial-2403↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:40:04.239682 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 10:40:04.267994 run osmo-hlr_10.42.42.2(pid=9459): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9459)] 10:40:04.319262 run osmo-hlr_10.42.42.2(pid=9459): stdout: | (launched: 2022-12-14_10:40:00.760783) 10:40:04.372103 run osmo-hlr_10.42.42.2(pid=9459): stderr: | 20221214104001042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104001042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104001042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104001042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104001042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104001042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104001055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104001067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104001067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104001067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:04.446119 run osmo-msc_10.42.42.6(pid=9468): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9468)] 10:40:04.497469 run osmo-msc_10.42.42.6(pid=9468): stdout: | (launched: 2022-12-14_10:40:03.300025) 10:40:04.550094 run osmo-msc_10.42.42.6(pid=9468): stderr: | 20221214104003620 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104003621 DLGLOBAL DEBUG validating counter group 0x7f1c570f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104003621 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104003621 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104003621 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104003621 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104003623 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104003623 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104003623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104003623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:40:04.602991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9458): Terminating (SIGTERM) 10:40:04.645342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9464): Terminating (SIGTERM) 10:40:04.687797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9467): Terminating (SIGTERM) 10:40:04.730907 --- ParallelTerminationStrategy: PID 9458 died... 10:40:04.750959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9458): Terminated: ok {rc=0} 10:40:04.797706 --- ParallelTerminationStrategy: PID 9464 died... 10:40:04.817327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9464): Terminated: ok {rc=0} 10:40:04.863719 --- ParallelTerminationStrategy: PID 9467 died... 10:40:04.883502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9467): Terminated: ok {rc=0} 10:40:04.972632 bus /sierra_3: Setting Powered False 10:40:06.070299 bus /sierra_3: Setting Powered False 10:40:07.188419 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:40:08.341549 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:40:08.354008 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:40:08.427812 tst mo_mt_call_osmux.py: using LAC 40359 10:40:08.557543 tst mo_mt_call_osmux.py: using RAC 69 10:40:08.689807 tst mo_mt_call_osmux.py: using CellId 40359 10:40:08.816634 tst mo_mt_call_osmux.py: using BVCI 40360 10:40:08.933649 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:40:08.945308 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:40:08.956700 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:40:08.968189 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:40:08.979727 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:40:08.991181 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:40:09.111864 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:40:09.231387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:09.733989 run create_hlr_db(pid=9470): Launched 10:40:09.867164 bus /sierra_2: Setting Powered False 10:40:10.931172 run create_hlr_db(pid=9470): Terminated: ok {rc=0} 10:40:11.367687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9472): Launched 10:40:11.693780 run osmo-hlr_10.42.42.2(pid=9473): Launched 10:40:11.819050 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:12.375706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9475): Launched 10:40:12.698828 run osmo-stp_10.42.42.5(pid=9476): Launched 10:40:12.821378 run osmo-msc_10.42.42.6: Starting osmo-msc 10:40:13.411599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9478): Launched 10:40:13.735901 run osmo-msc_10.42.42.6(pid=9479): Launched 10:40:13.915770 run osmo-stp_10.42.42.5(pid=9476): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9476)] 10:40:14.052027 run osmo-stp_10.42.42.5(pid=9476): stdout: | (launched: 2022-12-14_10:40:12.639889) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:14.188676 run osmo-stp_10.42.42.5(pid=9476): stderr: | 20221214104012828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104012828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104012828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104012829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104012829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104012829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104012830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:14.323881 run osmo-stp_10.42.42.5(pid=9476): stdout: | (launched: 2022-12-14_10:40:12.639889) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:14.451798 run osmo-stp_10.42.42.5(pid=9476): stderr: | 20221214104012828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104012828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104012828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104012829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104012829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104012829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104012830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:14.606201 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9476): Process ended prematurely: osmo-stp_10.42.42.5(pid=9476) [trial-2403↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9476)] [trial-2403↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:40:14.616012 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:40:14.644130 run osmo-hlr_10.42.42.2(pid=9473): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9473)] 10:40:14.694893 run osmo-hlr_10.42.42.2(pid=9473): stdout: | (launched: 2022-12-14_10:40:11.635057) 10:40:14.747090 run osmo-hlr_10.42.42.2(pid=9473): stderr: | 20221214104011829 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104011829 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104011829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104011829 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104011829 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104011830 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104011846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104011854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104011854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104011854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:14.820167 run osmo-msc_10.42.42.6(pid=9479): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9479)] 10:40:14.870620 run osmo-msc_10.42.42.6(pid=9479): stdout: | (launched: 2022-12-14_10:40:13.676475) 10:40:14.922807 run osmo-msc_10.42.42.6(pid=9479): stderr: | 20221214104013995 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104013995 DLGLOBAL DEBUG validating counter group 0x7fc531e4cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104013995 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104013995 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104013995 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104013996 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104013998 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104013998 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104013998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104013998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:40:14.975362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9472): Terminating (SIGTERM) 10:40:15.017675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9475): Terminating (SIGTERM) 10:40:15.060104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9478): Terminating (SIGTERM) 10:40:15.102521 --- ParallelTerminationStrategy: PID 9472 died... 10:40:15.122464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9472): Terminated: ok {rc=0} 10:40:15.168743 --- ParallelTerminationStrategy: PID 9475 died... 10:40:15.188625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9475): Terminated: ok {rc=0} 10:40:15.234761 --- ParallelTerminationStrategy: PID 9478 died... 10:40:15.254594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9478): Terminated: ok {rc=0} 10:40:15.342908 bus /sierra_3: Setting Powered False 10:40:16.450365 bus /sierra_3: Setting Powered False 10:40:17.581231 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:40:18.838094 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:40:18.844321 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:40:18.877877 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:40:18.904930 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:40:18.957073 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:40:18.990564 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:40:19.017965 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:40:19.568780 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:40:19.620333 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:40:19.631870 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:40:19.703776 tst mo_mt_call.py: using LAC 40360 10:40:19.831547 tst mo_mt_call.py: using RAC 70 10:40:19.952760 tst mo_mt_call.py: using CellId 40360 10:40:20.071605 tst mo_mt_call.py: using BVCI 40361 10:40:20.183866 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:40:20.194646 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:40:20.205591 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:40:20.216274 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:40:20.227276 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:40:20.238270 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:40:20.358704 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:40:20.476844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:20.948857 run create_hlr_db(pid=9485): Launched 10:40:21.065155 bus /sierra_2: Setting Powered False 10:40:22.126109 run create_hlr_db(pid=9485): Terminated: ok {rc=0} 10:40:22.550500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9487): Launched 10:40:22.855644 run osmo-hlr_10.42.42.2(pid=9488): Launched 10:40:22.972040 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:23.506396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9490): Launched 10:40:23.813299 run osmo-stp_10.42.42.5(pid=9491): Launched 10:40:23.930078 run osmo-msc_10.42.42.6: Starting osmo-msc 10:40:24.480875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9493): Launched 10:40:24.786825 run osmo-msc_10.42.42.6(pid=9494): Launched 10:40:24.958218 run osmo-stp_10.42.42.5(pid=9491): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9491)] 10:40:25.087236 run osmo-stp_10.42.42.5(pid=9491): stdout: | (launched: 2022-12-14_10:40:23.756880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:25.216321 run osmo-stp_10.42.42.5(pid=9491): stderr: | 20221214104023926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104023926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104023926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104023927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104023927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104023927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104023927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:25.343281 run osmo-stp_10.42.42.5(pid=9491): stdout: | (launched: 2022-12-14_10:40:23.756880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:25.464233 run osmo-stp_10.42.42.5(pid=9491): stderr: | 20221214104023926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104023926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104023926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104023927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104023927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104023927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104023927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:25.608746 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9491): Process ended prematurely: osmo-stp_10.42.42.5(pid=9491) [trial-2403↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9491)] [trial-2403↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:40:25.617943 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:40:25.644503 run osmo-hlr_10.42.42.2(pid=9488): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9488)] 10:40:25.693455 run osmo-hlr_10.42.42.2(pid=9488): stdout: | (launched: 2022-12-14_10:40:22.800162) 10:40:25.743339 run osmo-hlr_10.42.42.2(pid=9488): stderr: | 20221214104022972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104022972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104022972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104022972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104022972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104022972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104022986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104022994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104022994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104022994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:25.813442 run osmo-msc_10.42.42.6(pid=9494): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9494)] 10:40:25.861256 run osmo-msc_10.42.42.6(pid=9494): stdout: | (launched: 2022-12-14_10:40:24.731045) 10:40:25.911249 run osmo-msc_10.42.42.6(pid=9494): stderr: | 20221214104024999 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104024999 DLGLOBAL DEBUG validating counter group 0x7f07fed26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104024999 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104024999 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104024999 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104024999 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104025001 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104025002 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104025002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104025002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:40:25.961534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9487): Terminating (SIGTERM) 10:40:26.001747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9490): Terminating (SIGTERM) 10:40:26.041780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9493): Terminating (SIGTERM) 10:40:26.082149 --- ParallelTerminationStrategy: PID 9487 died... 10:40:26.101291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9487): Terminated: ok {rc=0} 10:40:26.145747 --- ParallelTerminationStrategy: PID 9490 died... 10:40:26.164702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9490): Terminated: ok {rc=0} 10:40:26.208939 --- ParallelTerminationStrategy: PID 9493 died... 10:40:26.227965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9493): Terminated: ok {rc=0} 10:40:26.315300 bus /sierra_3: Setting Powered False 10:40:27.416125 bus /sierra_3: Setting Powered False 10:40:28.530474 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:40:29.678990 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:40:29.691207 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:40:29.764196 tst mo_mt_call_osmux.py: using LAC 40361 10:40:29.891293 tst mo_mt_call_osmux.py: using RAC 71 10:40:30.018352 tst mo_mt_call_osmux.py: using CellId 40361 10:40:30.144915 tst mo_mt_call_osmux.py: using BVCI 40362 10:40:30.263108 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:40:30.274475 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:40:30.285625 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:40:30.296627 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:40:30.307784 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:40:30.319083 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:40:30.440366 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:40:30.559400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:31.063402 run create_hlr_db(pid=9496): Launched 10:40:31.230006 bus /sierra_2: Setting Powered False 10:40:32.293541 run create_hlr_db(pid=9496): Terminated: ok {rc=0} 10:40:32.732064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9498): Launched 10:40:33.035360 run osmo-hlr_10.42.42.2(pid=9499): Launched 10:40:33.150927 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:33.673204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9501): Launched 10:40:33.976151 run osmo-stp_10.42.42.5(pid=9502): Launched 10:40:34.091073 run osmo-msc_10.42.42.6: Starting osmo-msc 10:40:34.638373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9504): Launched 10:40:34.941482 run osmo-msc_10.42.42.6(pid=9505): Launched 10:40:35.111432 run osmo-stp_10.42.42.5(pid=9502): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9502)] 10:40:35.239925 run osmo-stp_10.42.42.5(pid=9502): stdout: | (launched: 2022-12-14_10:40:33.920593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:35.368692 run osmo-stp_10.42.42.5(pid=9502): stderr: | 20221214104034089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104034089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104034090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104034090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104034090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104034091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104034091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:35.495286 run osmo-stp_10.42.42.5(pid=9502): stdout: | (launched: 2022-12-14_10:40:33.920593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:35.615823 run osmo-stp_10.42.42.5(pid=9502): stderr: | 20221214104034089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104034089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104034090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104034090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104034090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104034091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104034091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:35.760198 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9502): Process ended prematurely: osmo-stp_10.42.42.5(pid=9502) [trial-2403↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9502)] [trial-2403↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:40:35.769417 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:40:35.796256 run osmo-hlr_10.42.42.2(pid=9499): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9499)] 10:40:35.845341 run osmo-hlr_10.42.42.2(pid=9499): stdout: | (launched: 2022-12-14_10:40:32.979936) 10:40:35.895756 run osmo-hlr_10.42.42.2(pid=9499): stderr: | 20221214104033152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104033152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104033152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104033152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104033152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104033152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104033164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104033172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104033173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104033173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:35.966209 run osmo-msc_10.42.42.6(pid=9505): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9505)] 10:40:36.014405 run osmo-msc_10.42.42.6(pid=9505): stdout: | (launched: 2022-12-14_10:40:34.885787) 10:40:36.064548 run osmo-msc_10.42.42.6(pid=9505): stderr: | 20221214104035154 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104035154 DLGLOBAL DEBUG validating counter group 0x7f75b34abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104035154 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104035154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104035154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104035155 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104035156 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104035157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104035157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104035157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:40:36.115301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9498): Terminating (SIGTERM) 10:40:36.155763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9501): Terminating (SIGTERM) 10:40:36.196156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9504): Terminating (SIGTERM) 10:40:36.236872 --- ParallelTerminationStrategy: PID 9498 died... 10:40:36.256738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9498): Terminated: ok {rc=0} 10:40:36.301321 --- ParallelTerminationStrategy: PID 9501 died... 10:40:36.320215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9501): Terminated: ok {rc=0} 10:40:36.364940 --- ParallelTerminationStrategy: PID 9504 died... 10:40:36.384236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9504): Terminated: ok {rc=0} 10:40:36.471807 bus /sierra_3: Setting Powered False 10:40:37.571742 bus /sierra_3: Setting Powered False 10:40:38.688451 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 emergency:trx-lms --------------------------------------------------------------------- 10:40:39.949079 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:40:39.955046 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 10:40:39.989286 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 10:40:40.017580 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 10:40:40.102767 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 10:40:40.136637 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 10:40:40.164111 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 10:40:40.749092 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2403 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 10:40:40.754359 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:40:40.765564 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 10:40:40.815958 tst emergency_mo_mt_call.py: using LAC 40362 10:40:40.935087 tst emergency_mo_mt_call.py: using RAC 72 10:40:41.051564 tst emergency_mo_mt_call.py: using CellId 40362 10:40:41.167315 tst emergency_mo_mt_call.py: using BVCI 40363 10:40:41.275677 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:40:41.286717 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:40:41.297446 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:40:41.307870 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:40:41.319175 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:40:41.330558 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:40:41.450759 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:40:41.569806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:42.031435 run create_hlr_db(pid=9511): Launched 10:40:42.145880 bus /sierra_2: Setting Powered False 10:40:43.205964 run create_hlr_db(pid=9511): Terminated: ok {rc=0} 10:40:43.642099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9513): Launched 10:40:43.960415 run osmo-hlr_10.42.42.2(pid=9514): Launched 10:40:44.082340 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:44.633645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9516): Launched 10:40:44.952013 run osmo-stp_10.42.42.5(pid=9517): Launched 10:40:45.082516 tst emergency_mo_mt_call.py: using MSISDN 8640 10:40:45.244249 run osmo-msc_10.42.42.6: Starting osmo-msc 10:40:45.814777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9519): Launched 10:40:46.141448 run osmo-msc_10.42.42.6(pid=9520): Launched 10:40:46.483876 run osmo-stp_10.42.42.5(pid=9517): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9517)] 10:40:46.710273 run osmo-stp_10.42.42.5(pid=9517): stdout: | (launched: 2022-12-14_10:40:44.894264) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:46.967797 run osmo-stp_10.42.42.5(pid=9517): stderr: | 20221214104045083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104045083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104045083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104045083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104045084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104045084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104045084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:47.107108 run osmo-stp_10.42.42.5(pid=9517): stdout: | (launched: 2022-12-14_10:40:44.894264) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:47.230284 run osmo-stp_10.42.42.5(pid=9517): stderr: | 20221214104045083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104045083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104045083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104045083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104045084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104045084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104045084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:47.375115 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9517): Process ended prematurely: osmo-stp_10.42.42.5(pid=9517) [trial-2403↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9517)] [trial-2403↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 10:40:47.383878 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 10:40:47.410176 run osmo-hlr_10.42.42.2(pid=9514): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9514)] 10:40:47.459299 run osmo-hlr_10.42.42.2(pid=9514): stdout: | (launched: 2022-12-14_10:40:43.902590) 10:40:47.509718 run osmo-hlr_10.42.42.2(pid=9514): stderr: | 20221214104044095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104044095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104044096 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104044096 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104044096 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104044096 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104044108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104044116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104044116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104044116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:47.580080 run osmo-msc_10.42.42.6(pid=9520): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9520)] 10:40:47.628227 run osmo-msc_10.42.42.6(pid=9520): stdout: | (launched: 2022-12-14_10:40:46.082019) 10:40:47.678458 run osmo-msc_10.42.42.6(pid=9520): stderr: | 20221214104046672 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104046673 DLGLOBAL DEBUG validating counter group 0x7fcdaae9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104046673 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104046673 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104046673 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104046673 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104046675 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104046675 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104046675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104046676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:40:47.729111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9513): Terminating (SIGTERM) 10:40:47.769495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9516): Terminating (SIGTERM) 10:40:47.809811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9519): Terminating (SIGTERM) 10:40:47.850866 --- ParallelTerminationStrategy: PID 9513 died... 10:40:47.870956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9513): Terminated: ok {rc=0} 10:40:47.916756 --- ParallelTerminationStrategy: PID 9516 died... 10:40:47.936332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9516): Terminated: ok {rc=0} 10:40:47.981293 --- ParallelTerminationStrategy: PID 9519 died... 10:40:48.000505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9519): Terminated: ok {rc=0} 10:40:48.088339 bus /sierra_3: Setting Powered False 10:40:49.187115 bus /sierra_3: Setting Powered False 10:40:50.301350 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 10:40:51.388487 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:40:51.400665 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 10:40:51.453034 tst emergency_preemptive_call.py: using LAC 40363 10:40:51.578164 tst emergency_preemptive_call.py: using RAC 73 10:40:51.702894 tst emergency_preemptive_call.py: using CellId 40363 10:40:51.829050 tst emergency_preemptive_call.py: using BVCI 40364 10:40:51.945744 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:40:51.957110 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:40:51.967989 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:40:51.981890 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:40:51.993860 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:40:52.004408 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:40:52.124597 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:40:52.245383 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:40:52.362222 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:40:52.482100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:52.975481 run create_hlr_db(pid=9524): Launched 10:40:53.105690 bus /sierra_2: Setting Powered False 10:40:54.168766 run create_hlr_db(pid=9524): Terminated: ok {rc=0} 10:40:54.597629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9526): Launched 10:40:54.897845 run osmo-hlr_10.42.42.2(pid=9527): Launched 10:40:55.012353 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:55.524804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9529): Launched 10:40:55.823386 run osmo-stp_10.42.42.5(pid=9530): Launched 10:40:55.947276 tst emergency_preemptive_call.py: using MSISDN 8641 10:40:56.099445 run osmo-msc_10.42.42.6: Starting osmo-msc 10:40:56.635965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9532): Launched 10:40:56.936305 run osmo-msc_10.42.42.6(pid=9533): Launched 10:40:57.103142 run osmo-stp_10.42.42.5(pid=9530): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9530)] 10:40:57.228793 run osmo-stp_10.42.42.5(pid=9530): stdout: | (launched: 2022-12-14_10:40:55.768369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:57.355173 run osmo-stp_10.42.42.5(pid=9530): stderr: | 20221214104055934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104055934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104055934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104055935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104055935 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104055935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104055936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:57.479323 run osmo-stp_10.42.42.5(pid=9530): stdout: | (launched: 2022-12-14_10:40:55.768369) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:57.597898 run osmo-stp_10.42.42.5(pid=9530): stderr: | 20221214104055934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104055934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104055934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104055935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104055935 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104055935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104055936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:57.739725 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9530): Process ended prematurely: osmo-stp_10.42.42.5(pid=9530) [trial-2403↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9530)] [trial-2403↪emergency:trx-lms↪emergency_preemptive_call.py:32] 10:40:57.748460 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 10:40:57.774650 run osmo-hlr_10.42.42.2(pid=9527): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9527)] 10:40:57.823726 run osmo-hlr_10.42.42.2(pid=9527): stdout: | (launched: 2022-12-14_10:40:54.842516) 10:40:57.874073 run osmo-hlr_10.42.42.2(pid=9527): stderr: | 20221214104055013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104055013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104055013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104055013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104055013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104055013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104055025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104055034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104055034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104055035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:57.944532 run osmo-msc_10.42.42.6(pid=9533): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9533)] 10:40:57.992940 run osmo-msc_10.42.42.6(pid=9533): stdout: | (launched: 2022-12-14_10:40:56.880880) 10:40:58.043065 run osmo-msc_10.42.42.6(pid=9533): stderr: | 20221214104057150 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104057150 DLGLOBAL DEBUG validating counter group 0x7fc77d695c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104057150 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104057150 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104057150 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104057151 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104057152 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104057153 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104057153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104057153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:40:58.093372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9526): Terminating (SIGTERM) 10:40:58.133909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9529): Terminating (SIGTERM) 10:40:58.174189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9532): Terminating (SIGTERM) 10:40:58.214748 --- ParallelTerminationStrategy: PID 9526 died... 10:40:58.234606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9526): Terminated: ok {rc=0} 10:40:58.279058 --- ParallelTerminationStrategy: PID 9529 died... 10:40:58.298217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9529): Terminated: ok {rc=0} 10:40:58.342639 --- ParallelTerminationStrategy: PID 9532 died... 10:40:58.361828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9532): Terminated: ok {rc=0} 10:40:58.449841 bus /sierra_9: Setting Powered False 10:40:59.551620 bus /sierra_9: Setting Powered False 10:41:00.670215 bus /sierra_8: Setting Powered False 10:41:01.780894 bus /sierra_8: Setting Powered False 10:41:02.918245 bus /sierra_3: Setting Powered False 10:41:04.018438 bus /sierra_3: Setting Powered False 10:41:05.137990 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-lms --------------------------------------------------------------------- 10:41:06.419187 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:41:06.423937 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 10:41:06.457923 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 10:41:06.497461 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 10:41:06.586307 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 10:41:06.620031 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 10:41:06.659605 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 10:41:07.249483 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 10:41:07.302026 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:07.313132 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:41:07.362835 tst cs_paging_gprs_active.py: using LAC 40364 10:41:07.492151 tst cs_paging_gprs_active.py: using RAC 74 10:41:07.618307 tst cs_paging_gprs_active.py: using CellId 40364 10:41:07.746582 tst cs_paging_gprs_active.py: using BVCI 40365 10:41:07.863714 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:07.874978 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:07.885919 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:07.896736 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:07.907587 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:07.918455 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:07.929496 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:07.940288 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:07.951289 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:41:08.070653 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:41:08.186884 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:41:08.392030 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:08.697596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9538): Launched 10:41:08.963604 run iperf3-srv_10.42.42.10(pid=9539): Launched 10:41:09.078299 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:41:09.281258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:09.585530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9540): Launched 10:41:09.851523 run iperf3-srv_10.42.42.10(pid=9541): Launched 10:41:09.966101 tst cs_paging_gprs_active.py:38: start network... 10:41:10.170017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:10.641158 run create_hlr_db(pid=9542): Launched 10:41:10.758880 bus /sierra_2: Setting Powered False 10:41:11.819467 run create_hlr_db(pid=9542): Terminated: ok {rc=0} 10:41:12.266129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9544): Launched 10:41:12.592547 run osmo-hlr_10.42.42.2(pid=9545): Launched 10:41:12.715614 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:13.283122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9547): Launched 10:41:13.608264 run osmo-stp_10.42.42.5(pid=9548): Launched 10:41:13.731450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:41:14.290352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9550): Launched 10:41:14.415816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:41:14.689811 run patchelf(pid=9551): Launched 10:41:14.871763 run osmo-stp_10.42.42.5(pid=9548): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9548)] 10:41:15.009646 run osmo-stp_10.42.42.5(pid=9548): stdout: | (launched: 2022-12-14_10:41:13.549294) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:15.149927 run osmo-stp_10.42.42.5(pid=9548): stderr: | 20221214104113737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104113738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104113738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104113738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104113739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104113739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104113739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:15.288405 run osmo-stp_10.42.42.5(pid=9548): stdout: | (launched: 2022-12-14_10:41:13.549294) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:15.421303 run osmo-stp_10.42.42.5(pid=9548): stderr: | 20221214104113737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104113738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104113738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104113738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104113739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104113739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104113739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:15.578418 run patchelf(pid=9551): Terminating (SIGINT) 10:41:15.760301 run patchelf(pid=9551): Terminated: ok {rc=0} 10:41:15.920723 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9548): Process ended prematurely: osmo-stp_10.42.42.5(pid=9548) [trial-2403↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9548)] [trial-2403↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 10:41:15.931542 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:41:15.960506 run osmo-hlr_10.42.42.2(pid=9545): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9545)] 10:41:16.015887 run osmo-hlr_10.42.42.2(pid=9545): stdout: | (launched: 2022-12-14_10:41:12.533294) 10:41:16.067612 run osmo-hlr_10.42.42.2(pid=9545): stderr: | 20221214104112728 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104112728 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104112728 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104112728 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104112728 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104112728 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104112742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104112751 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104112751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104112751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:16.123887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9538): Terminating (SIGTERM) 10:41:16.165656 run iperf3-srv_10.42.42.10(pid=9539): Terminating (SIGTERM) 10:41:16.207955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9540): Terminating (SIGTERM) 10:41:16.251369 run iperf3-srv_10.42.42.10(pid=9541): Terminating (SIGTERM) 10:41:16.296311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9544): Terminating (SIGTERM) 10:41:16.339597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9547): Terminating (SIGTERM) 10:41:16.384685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9550): Terminating (SIGTERM) 10:41:16.430467 --- ParallelTerminationStrategy: PID 9538 died... 10:41:16.451852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9538): Terminated: ok {rc=0} 10:41:16.501241 --- ParallelTerminationStrategy: PID 9539 died... 10:41:16.522512 run iperf3-srv_10.42.42.10(pid=9539): Terminated {rc=256} 10:41:16.569572 --- ParallelTerminationStrategy: PID 9540 died... 10:41:16.590474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9540): Terminated: ok {rc=0} 10:41:16.637741 --- ParallelTerminationStrategy: PID 9541 died... 10:41:16.658977 run iperf3-srv_10.42.42.10(pid=9541): Terminated {rc=256} 10:41:16.707020 --- ParallelTerminationStrategy: PID 9544 died... 10:41:16.728183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9544): Terminated: ok {rc=0} 10:41:16.775111 --- ParallelTerminationStrategy: PID 9547 died... 10:41:16.796121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9547): Terminated: ok {rc=0} 10:41:16.843279 --- ParallelTerminationStrategy: PID 9550 died... 10:41:16.864713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9550): Terminated: ok {rc=0} 10:41:16.955020 bus /gobi_0: Setting Powered False 10:41:18.056597 bus /gobi_0: Setting Powered False 10:41:19.174317 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms iperf3.py ---------------------------------------------- 10:41:20.322380 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:20.333725 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:41:20.385674 tst iperf3.py: using LAC 40365 10:41:20.513926 tst iperf3.py: using RAC 75 10:41:20.635575 tst iperf3.py: using CellId 40365 10:41:20.756894 tst iperf3.py: using BVCI 40366 10:41:20.867232 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:20.878158 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:20.888569 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:20.899109 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:20.909735 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:20.920468 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:20.932223 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:20.942997 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:20.954147 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:41:21.074591 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:41:21.294186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:21.620154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9552): Launched 10:41:21.904133 run iperf3-srv_10.42.42.10(pid=9553): Launched 10:41:22.026595 tst iperf3.py:8: start network... 10:41:22.246117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:22.748130 run create_hlr_db(pid=9554): Launched 10:41:22.880440 bus /gobi_6: Setting Powered False 10:41:23.944674 run create_hlr_db(pid=9554): Terminated: ok {rc=0} 10:41:24.380042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9556): Launched 10:41:24.685572 run osmo-hlr_10.42.42.2(pid=9557): Launched 10:41:24.803443 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:25.335372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9559): Launched 10:41:25.640145 run osmo-stp_10.42.42.5(pid=9560): Launched 10:41:25.759247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:41:26.283413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9562): Launched 10:41:26.402632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:41:26.659615 run patchelf(pid=9563): Launched 10:41:26.830529 run osmo-stp_10.42.42.5(pid=9560): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9560)] 10:41:26.960274 run osmo-stp_10.42.42.5(pid=9560): stdout: | (launched: 2022-12-14_10:41:25.584207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:27.091580 run osmo-stp_10.42.42.5(pid=9560): stderr: | 20221214104125753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104125753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104125753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104125754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104125754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104125754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104125755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:27.223241 run osmo-stp_10.42.42.5(pid=9560): stdout: | (launched: 2022-12-14_10:41:25.584207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:27.349073 run osmo-stp_10.42.42.5(pid=9560): stderr: | 20221214104125753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104125753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104125753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104125754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104125754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104125754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104125755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:27.497356 run patchelf(pid=9563): Terminating (SIGINT) 10:41:27.669215 run patchelf(pid=9563): Terminated: ok {rc=0} 10:41:27.793321 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9560): Process ended prematurely: osmo-stp_10.42.42.5(pid=9560) [trial-2403↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9560)] [trial-2403↪gprs:trx-lms↪iperf3.py:8] 10:41:27.802944 tst iperf3.py:8: Test FAILED (7.5 sec) 10:41:27.830571 run osmo-hlr_10.42.42.2(pid=9557): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9557)] 10:41:27.879173 run osmo-hlr_10.42.42.2(pid=9557): stdout: | (launched: 2022-12-14_10:41:24.629686) 10:41:27.929648 run osmo-hlr_10.42.42.2(pid=9557): stderr: | 20221214104124799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104124799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104124799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104124800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104124800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104124800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104124812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104124820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104124820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104124820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:27.980449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9552): Terminating (SIGTERM) 10:41:28.021192 run iperf3-srv_10.42.42.10(pid=9553): Terminating (SIGTERM) 10:41:28.061674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9556): Terminating (SIGTERM) 10:41:28.102257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9559): Terminating (SIGTERM) 10:41:28.142681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9562): Terminating (SIGTERM) 10:41:28.183202 --- ParallelTerminationStrategy: PID 9552 died... 10:41:28.203041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9552): Terminated: ok {rc=0} 10:41:28.247642 --- ParallelTerminationStrategy: PID 9553 died... 10:41:28.266640 run iperf3-srv_10.42.42.10(pid=9553): Terminated {rc=256} 10:41:28.311049 --- ParallelTerminationStrategy: PID 9556 died... 10:41:28.330285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9556): Terminated: ok {rc=0} 10:41:28.374617 --- ParallelTerminationStrategy: PID 9559 died... 10:41:28.393619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9559): Terminated: ok {rc=0} 10:41:28.437964 --- ParallelTerminationStrategy: PID 9562 died... 10:41:28.457080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9562): Terminated: ok {rc=0} 10:41:28.544088 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms iperf3m4.py ---------------------------------------------- 10:41:29.691678 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:29.703064 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:41:29.753427 tst iperf3m4.py: using LAC 40366 10:41:29.886684 tst iperf3m4.py: using RAC 76 10:41:30.014295 tst iperf3m4.py: using CellId 40366 10:41:30.142834 tst iperf3m4.py: using BVCI 40367 10:41:30.262723 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:30.274124 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:30.285256 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:30.296278 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:30.307741 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:30.319246 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:30.330921 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:30.342470 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:30.354040 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:41:30.472618 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:41:30.599428 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:41:30.717095 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:41:30.843722 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:41:31.103016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:31.495658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9564): Launched 10:41:31.795317 run iperf3-srv_10.42.42.10(pid=9565): Launched 10:41:31.933655 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:41:32.156576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:32.483205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9566): Launched 10:41:32.766951 run iperf3-srv_10.42.42.10(pid=9567): Launched 10:41:32.889769 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:41:33.107057 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:33.433473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9568): Launched 10:41:33.714828 run iperf3-srv_10.42.42.10(pid=9569): Launched 10:41:33.837612 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:41:34.054922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:41:34.379544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9570): Launched 10:41:34.661670 run iperf3-srv_10.42.42.10(pid=9571): Launched 10:41:34.784275 tst iperf3m4.py:8: start network... 10:41:35.002167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:35.504758 run create_hlr_db(pid=9572): Launched 10:41:35.637117 bus /gobi_6: Setting Powered False 10:41:36.701102 run create_hlr_db(pid=9572): Terminated: ok {rc=0} 10:41:37.134775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9574): Launched 10:41:37.441282 run osmo-hlr_10.42.42.2(pid=9575): Launched 10:41:37.568608 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:38.099285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9577): Launched 10:41:38.404637 run osmo-stp_10.42.42.5(pid=9578): Launched 10:41:38.521495 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:41:39.044621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9580): Launched 10:41:39.161472 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:41:39.417849 run patchelf(pid=9581): Launched 10:41:39.588021 run osmo-stp_10.42.42.5(pid=9578): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9578)] 10:41:39.717579 run osmo-stp_10.42.42.5(pid=9578): stdout: | (launched: 2022-12-14_10:41:38.348637) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:39.848148 run osmo-stp_10.42.42.5(pid=9578): stderr: | 20221214104138518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104138518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104138518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104138519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104138519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104138519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104138519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:39.983718 run osmo-stp_10.42.42.5(pid=9578): stdout: | (launched: 2022-12-14_10:41:38.348637) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:40.117838 run osmo-stp_10.42.42.5(pid=9578): stderr: | 20221214104138518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104138518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104138518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104138519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104138519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104138519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104138519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:40.274820 run patchelf(pid=9581): Terminating (SIGINT) 10:41:40.456266 run patchelf(pid=9581): Terminated: ok {rc=0} 10:41:40.587799 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9578): Process ended prematurely: osmo-stp_10.42.42.5(pid=9578) [trial-2403↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9578)] [trial-2403↪gprs:trx-lms↪iperf3m4.py:8] 10:41:40.598232 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:41:40.627290 run osmo-hlr_10.42.42.2(pid=9575): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9575)] 10:41:40.677563 run osmo-hlr_10.42.42.2(pid=9575): stdout: | (launched: 2022-12-14_10:41:37.385341) 10:41:40.729867 run osmo-hlr_10.42.42.2(pid=9575): stderr: | 20221214104137570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104137570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104137570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104137570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104137570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104137570 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104137582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104137592 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104137592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104137592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:40.782217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9564): Terminating (SIGTERM) 10:41:40.824088 run iperf3-srv_10.42.42.10(pid=9565): Terminating (SIGTERM) 10:41:40.866110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9566): Terminating (SIGTERM) 10:41:40.908460 run iperf3-srv_10.42.42.10(pid=9567): Terminating (SIGTERM) 10:41:40.950309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9568): Terminating (SIGTERM) 10:41:40.992335 run iperf3-srv_10.42.42.10(pid=9569): Terminating (SIGTERM) 10:41:41.034264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9570): Terminating (SIGTERM) 10:41:41.076455 run iperf3-srv_10.42.42.10(pid=9571): Terminating (SIGTERM) 10:41:41.118512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9574): Terminating (SIGTERM) 10:41:41.160524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9577): Terminating (SIGTERM) 10:41:41.202519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9580): Terminating (SIGTERM) 10:41:41.245129 --- ParallelTerminationStrategy: PID 9564 died... 10:41:41.265453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9564): Terminated: ok {rc=0} 10:41:41.311844 --- ParallelTerminationStrategy: PID 9565 died... 10:41:41.331544 run iperf3-srv_10.42.42.10(pid=9565): Terminated {rc=256} 10:41:41.377724 --- ParallelTerminationStrategy: PID 9566 died... 10:41:41.397423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9566): Terminated: ok {rc=0} 10:41:41.443758 --- ParallelTerminationStrategy: PID 9567 died... 10:41:41.463523 run iperf3-srv_10.42.42.10(pid=9567): Terminated {rc=256} 10:41:41.509736 --- ParallelTerminationStrategy: PID 9568 died... 10:41:41.529487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9568): Terminated: ok {rc=0} 10:41:41.575746 --- ParallelTerminationStrategy: PID 9569 died... 10:41:41.595420 run iperf3-srv_10.42.42.10(pid=9569): Terminated {rc=256} 10:41:41.641721 --- ParallelTerminationStrategy: PID 9570 died... 10:41:41.661409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9570): Terminated: ok {rc=0} 10:41:41.707653 --- ParallelTerminationStrategy: PID 9571 died... 10:41:41.727352 run iperf3-srv_10.42.42.10(pid=9571): Terminated {rc=256} 10:41:41.773521 --- ParallelTerminationStrategy: PID 9574 died... 10:41:41.793436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9574): Terminated: ok {rc=0} 10:41:41.839657 --- ParallelTerminationStrategy: PID 9577 died... 10:41:41.859362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9577): Terminated: ok {rc=0} 10:41:41.905688 --- ParallelTerminationStrategy: PID 9580 died... 10:41:41.925543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9580): Terminated: ok {rc=0} 10:41:42.013912 bus /gobi_4: Setting Powered False 10:41:43.112937 bus /gobi_4: Setting Powered False 10:41:44.233470 bus /gobi_1: Setting Powered False 10:41:45.331751 bus /gobi_1: Setting Powered False 10:41:46.456584 bus /gobi_0: Setting Powered False 10:41:47.557241 bus /gobi_0: Setting Powered False 10:41:48.674486 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms ping.py ---------------------------------------------- 10:41:49.778824 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:49.790015 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:41:49.839545 tst ping.py: using LAC 40367 10:41:49.963418 tst ping.py: using RAC 77 10:41:50.086798 tst ping.py: using CellId 40367 10:41:50.209821 tst ping.py: using BVCI 40368 10:41:50.323927 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:50.335119 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:50.346339 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:50.357341 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:50.368223 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:50.379242 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:50.390434 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:50.401535 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:41:50.519401 tst ping.py:19: start network... 10:41:50.733154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:51.223961 run create_hlr_db(pid=9582): Launched 10:41:51.354121 bus /gobi_6: Setting Powered False 10:41:52.414175 run create_hlr_db(pid=9582): Terminated: ok {rc=0} 10:41:52.838862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9584): Launched 10:41:53.137896 run osmo-hlr_10.42.42.2(pid=9585): Launched 10:41:53.254042 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:53.774748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9587): Launched 10:41:54.075815 run osmo-stp_10.42.42.5(pid=9588): Launched 10:41:54.189650 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:41:54.702553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9590): Launched 10:41:54.817180 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:41:55.069159 run patchelf(pid=9591): Launched 10:41:55.235304 run osmo-stp_10.42.42.5(pid=9588): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9588)] 10:41:55.362593 run osmo-stp_10.42.42.5(pid=9588): stdout: | (launched: 2022-12-14_10:41:54.020685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:55.491439 run osmo-stp_10.42.42.5(pid=9588): stderr: | 20221214104154186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104154186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104154186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104154187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104154187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104154187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104154188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:55.620049 run osmo-stp_10.42.42.5(pid=9588): stdout: | (launched: 2022-12-14_10:41:54.020685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:55.742353 run osmo-stp_10.42.42.5(pid=9588): stderr: | 20221214104154186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104154186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104154186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104154187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104154187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104154187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104154188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:55.886957 run patchelf(pid=9591): Terminating (SIGINT) 10:41:56.055677 run patchelf(pid=9591): Terminated: ok {rc=0} 10:41:56.176896 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9588): Process ended prematurely: osmo-stp_10.42.42.5(pid=9588) [trial-2403↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9588)] [trial-2403↪gprs:trx-lms↪ping.py:22] 10:41:56.186145 tst ping.py:22: Test FAILED (6.4 sec) 10:41:56.213237 run osmo-hlr_10.42.42.2(pid=9585): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9585)] 10:41:56.261829 run osmo-hlr_10.42.42.2(pid=9585): stdout: | (launched: 2022-12-14_10:41:53.082902) 10:41:56.311972 run osmo-hlr_10.42.42.2(pid=9585): stderr: | 20221214104153255 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104153255 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104153255 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104153255 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104153255 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104153255 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104153267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104153277 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104153278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104153278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:56.362571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9584): Terminating (SIGTERM) 10:41:56.402935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9587): Terminating (SIGTERM) 10:41:56.443151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9590): Terminating (SIGTERM) 10:41:56.483465 --- ParallelTerminationStrategy: PID 9584 died... 10:41:56.503151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9584): Terminated: ok {rc=0} 10:41:56.547724 --- ParallelTerminationStrategy: PID 9587 died... 10:41:56.566769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9587): Terminated: ok {rc=0} 10:41:56.611179 --- ParallelTerminationStrategy: PID 9590 died... 10:41:56.630339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9590): Terminated: ok {rc=0} 10:41:56.714643 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 10:41:57.802849 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:57.814706 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:41:57.870147 tst ping_idle_ping.py: using LAC 40368 10:41:57.994615 tst ping_idle_ping.py: using RAC 78 10:41:58.120060 tst ping_idle_ping.py: using CellId 40368 10:41:58.243660 tst ping_idle_ping.py: using BVCI 40369 10:41:58.359041 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:58.370271 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:58.381175 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:58.391967 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:58.402969 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:58.414069 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:58.425130 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:41:58.436197 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:41:58.555252 tst ping_idle_ping.py:24: start network... 10:41:58.769847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:59.265601 run create_hlr_db(pid=9592): Launched 10:41:59.397699 bus /gobi_6: Setting Powered False 10:42:00.461960 run create_hlr_db(pid=9592): Terminated: ok {rc=0} 10:42:00.951021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9596): Launched 10:42:01.389305 run osmo-hlr_10.42.42.2(pid=9599): Launched 10:42:01.634746 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:02.342913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9601): Launched 10:42:02.671904 run osmo-stp_10.42.42.5(pid=9602): Launched 10:42:02.793046 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:42:03.341507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9604): Launched 10:42:03.465411 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:42:03.733713 run patchelf(pid=9605): Launched 10:42:03.912092 run osmo-stp_10.42.42.5(pid=9602): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9602)] 10:42:04.046841 run osmo-stp_10.42.42.5(pid=9602): stdout: | (launched: 2022-12-14_10:42:02.613546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:04.183890 run osmo-stp_10.42.42.5(pid=9602): stderr: | 20221214104202802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104202802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104202802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104202803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104202803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104202803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104202803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:04.319932 run osmo-stp_10.42.42.5(pid=9602): stdout: | (launched: 2022-12-14_10:42:02.613546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:04.450402 run osmo-stp_10.42.42.5(pid=9602): stderr: | 20221214104202802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104202802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104202802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104202803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104202803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104202803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104202803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:04.604934 run patchelf(pid=9605): Terminating (SIGINT) 10:42:04.783103 run patchelf(pid=9605): Terminated: ok {rc=0} 10:42:04.911884 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9602): Process ended prematurely: osmo-stp_10.42.42.5(pid=9602) [trial-2403↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9602)] [trial-2403↪gprs:trx-lms↪ping_idle_ping.py:27] 10:42:04.921650 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 10:42:04.950083 run osmo-hlr_10.42.42.2(pid=9599): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9599)] 10:42:05.000340 run osmo-hlr_10.42.42.2(pid=9599): stdout: | (launched: 2022-12-14_10:42:01.328270) 10:42:05.052808 run osmo-hlr_10.42.42.2(pid=9599): stderr: | 20221214104201694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104201694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104201694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104201694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104201694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104201695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104201715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104201727 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104201727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104201727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:05.105843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9596): Terminating (SIGTERM) 10:42:05.148136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9601): Terminating (SIGTERM) 10:42:05.190340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9604): Terminating (SIGTERM) 10:42:05.232623 --- ParallelTerminationStrategy: PID 9596 died... 10:42:05.252891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9596): Terminated: ok {rc=0} 10:42:05.299625 --- ParallelTerminationStrategy: PID 9601 died... 10:42:05.319374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9601): Terminated: ok {rc=0} 10:42:05.365750 --- ParallelTerminationStrategy: PID 9604 died... 10:42:05.385476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9604): Terminated: ok {rc=0} 10:42:05.474114 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 10:42:06.770802 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:42:06.776542 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:42:06.809091 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:42:06.847723 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:42:06.935497 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:42:06.970030 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:42:07.008143 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:42:07.597378 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:42:07.646704 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:07.657543 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:42:07.711065 tst cs_paging_gprs_active.py: using LAC 40369 10:42:07.839029 tst cs_paging_gprs_active.py: using RAC 79 10:42:07.965580 tst cs_paging_gprs_active.py: using CellId 40369 10:42:08.094519 tst cs_paging_gprs_active.py: using BVCI 40370 10:42:08.206419 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:08.217740 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:08.228566 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:08.239355 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:08.250399 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:08.261508 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:08.272547 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:08.283365 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:08.294405 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:42:08.417775 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:42:08.536053 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:42:08.741245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:42:09.048279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9609): Launched 10:42:09.316169 run iperf3-srv_10.42.42.10(pid=9610): Launched 10:42:09.431704 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:42:09.636130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:42:09.942596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9611): Launched 10:42:10.210750 run iperf3-srv_10.42.42.10(pid=9612): Launched 10:42:10.325812 tst cs_paging_gprs_active.py:38: start network... 10:42:10.529810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:10.999939 run create_hlr_db(pid=9613): Launched 10:42:11.116766 bus /gobi_6: Setting Powered False 10:42:12.177734 run create_hlr_db(pid=9613): Terminated: ok {rc=0} 10:42:12.603040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9615): Launched 10:42:12.908285 run osmo-hlr_10.42.42.2(pid=9616): Launched 10:42:13.024281 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:13.562191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9618): Launched 10:42:13.867703 run osmo-stp_10.42.42.5(pid=9619): Launched 10:42:13.983890 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:42:14.508444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9621): Launched 10:42:14.625626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:42:14.883442 run patchelf(pid=9622): Launched 10:42:15.055287 run osmo-stp_10.42.42.5(pid=9619): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9619)] 10:42:15.185575 run osmo-stp_10.42.42.5(pid=9619): stdout: | (launched: 2022-12-14_10:42:13.811965) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:15.316102 run osmo-stp_10.42.42.5(pid=9619): stderr: | 20221214104213980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104213980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104213980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104213981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104213981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104213981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104213981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:15.446551 run osmo-stp_10.42.42.5(pid=9619): stdout: | (launched: 2022-12-14_10:42:13.811965) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:15.571701 run osmo-stp_10.42.42.5(pid=9619): stderr: | 20221214104213980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104213980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104213980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104213981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104213981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104213981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104213981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:15.719266 run patchelf(pid=9622): Terminating (SIGINT) 10:42:15.897206 run patchelf(pid=9622): Terminated: ok {rc=0} 10:42:16.027155 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9619): Process ended prematurely: osmo-stp_10.42.42.5(pid=9619) [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9619)] [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:42:16.038135 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 10:42:16.067292 run osmo-hlr_10.42.42.2(pid=9616): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9616)] 10:42:16.118424 run osmo-hlr_10.42.42.2(pid=9616): stdout: | (launched: 2022-12-14_10:42:12.851922) 10:42:16.171032 run osmo-hlr_10.42.42.2(pid=9616): stderr: | 20221214104213024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104213024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104213024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104213024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104213024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104213024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104213036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104213045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104213045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104213045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:16.222627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9609): Terminating (SIGTERM) 10:42:16.265194 run iperf3-srv_10.42.42.10(pid=9610): Terminating (SIGTERM) 10:42:16.309935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9611): Terminating (SIGTERM) 10:42:16.352301 run iperf3-srv_10.42.42.10(pid=9612): Terminating (SIGTERM) 10:42:16.393863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9615): Terminating (SIGTERM) 10:42:16.435147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9618): Terminating (SIGTERM) 10:42:16.476305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9621): Terminating (SIGTERM) 10:42:16.517619 --- ParallelTerminationStrategy: PID 9609 died... 10:42:16.538258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9609): Terminated: ok {rc=0} 10:42:16.584188 --- ParallelTerminationStrategy: PID 9610 died... 10:42:16.604388 run iperf3-srv_10.42.42.10(pid=9610): Terminated {rc=256} 10:42:16.650232 --- ParallelTerminationStrategy: PID 9611 died... 10:42:16.670574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9611): Terminated: ok {rc=0} 10:42:16.716271 --- ParallelTerminationStrategy: PID 9612 died... 10:42:16.736429 run iperf3-srv_10.42.42.10(pid=9612): Terminated {rc=256} 10:42:16.782309 --- ParallelTerminationStrategy: PID 9615 died... 10:42:16.802895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9615): Terminated: ok {rc=0} 10:42:16.848761 --- ParallelTerminationStrategy: PID 9618 died... 10:42:16.869348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9618): Terminated: ok {rc=0} 10:42:16.915058 --- ParallelTerminationStrategy: PID 9621 died... 10:42:16.935332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9621): Terminated: ok {rc=0} 10:42:17.022167 bus /gobi_0: Setting Powered False 10:42:18.121394 bus /gobi_0: Setting Powered False 10:42:19.238155 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:42:20.386365 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:20.398531 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:42:20.450926 tst iperf3.py: using LAC 40370 10:42:20.577591 tst iperf3.py: using RAC 80 10:42:20.702959 tst iperf3.py: using CellId 40370 10:42:20.822510 tst iperf3.py: using BVCI 40371 10:42:20.935001 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:20.946109 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:20.956707 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:20.967350 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:20.978205 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:20.989172 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:21.000237 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:21.011014 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:21.022035 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:42:21.143285 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:42:21.362347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:42:21.688123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9623): Launched 10:42:21.969657 run iperf3-srv_10.42.42.10(pid=9624): Launched 10:42:22.092940 tst iperf3.py:8: start network... 10:42:22.310877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:22.811365 run create_hlr_db(pid=9625): Launched 10:42:22.942886 bus /gobi_6: Setting Powered False 10:42:24.007133 run create_hlr_db(pid=9625): Terminated: ok {rc=0} 10:42:24.446786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9627): Launched 10:42:24.754156 run osmo-hlr_10.42.42.2(pid=9628): Launched 10:42:24.870604 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:25.409790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9630): Launched 10:42:25.715729 run osmo-stp_10.42.42.5(pid=9631): Launched 10:42:25.831941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:42:26.355838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9633): Launched 10:42:26.481409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:42:26.754091 run patchelf(pid=9634): Launched 10:42:26.935740 run osmo-stp_10.42.42.5(pid=9631): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9631)] 10:42:27.072793 run osmo-stp_10.42.42.5(pid=9631): stdout: | (launched: 2022-12-14_10:42:25.659722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:27.211307 run osmo-stp_10.42.42.5(pid=9631): stderr: | 20221214104225826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104225826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104225826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104225827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104225827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104225827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104225827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:27.350033 run osmo-stp_10.42.42.5(pid=9631): stdout: | (launched: 2022-12-14_10:42:25.659722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:27.482379 run osmo-stp_10.42.42.5(pid=9631): stderr: | 20221214104225826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104225826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104225826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104225827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104225827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104225827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104225827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:27.639463 run patchelf(pid=9634): Terminating (SIGINT) 10:42:27.821239 run patchelf(pid=9634): Terminated: ok {rc=0} 10:42:27.952286 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9631): Process ended prematurely: osmo-stp_10.42.42.5(pid=9631) [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9631)] [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 10:42:27.962624 tst iperf3.py:8: Test FAILED (7.6 sec) 10:42:27.991484 run osmo-hlr_10.42.42.2(pid=9628): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9628)] 10:42:28.042075 run osmo-hlr_10.42.42.2(pid=9628): stdout: | (launched: 2022-12-14_10:42:24.698229) 10:42:28.095315 run osmo-hlr_10.42.42.2(pid=9628): stderr: | 20221214104224870 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104224870 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104224870 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104224870 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104224871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104224871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104224883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104224891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104224892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104224892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:28.148281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9623): Terminating (SIGTERM) 10:42:28.190558 run iperf3-srv_10.42.42.10(pid=9624): Terminating (SIGTERM) 10:42:28.233096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9627): Terminating (SIGTERM) 10:42:28.275694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9630): Terminating (SIGTERM) 10:42:28.318084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9633): Terminating (SIGTERM) 10:42:28.360812 --- ParallelTerminationStrategy: PID 9623 died... 10:42:28.381160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9623): Terminated: ok {rc=0} 10:42:28.427674 --- ParallelTerminationStrategy: PID 9624 died... 10:42:28.447525 run iperf3-srv_10.42.42.10(pid=9624): Terminated {rc=256} 10:42:28.493612 --- ParallelTerminationStrategy: PID 9627 died... 10:42:28.513298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9627): Terminated: ok {rc=0} 10:42:28.559640 --- ParallelTerminationStrategy: PID 9630 died... 10:42:28.579278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9630): Terminated: ok {rc=0} 10:42:28.625421 --- ParallelTerminationStrategy: PID 9633 died... 10:42:28.645094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9633): Terminated: ok {rc=0} 10:42:28.733983 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:42:29.887944 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:29.900247 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:42:29.950279 tst iperf3m4.py: using LAC 40371 10:42:30.070473 tst iperf3m4.py: using RAC 81 10:42:30.191393 tst iperf3m4.py: using CellId 40371 10:42:30.319196 tst iperf3m4.py: using BVCI 40372 10:42:30.436492 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:30.447936 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:30.459342 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:30.470676 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:30.481801 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:30.492846 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:30.504208 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:30.515332 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:30.526626 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:42:30.646489 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:42:30.769543 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:42:30.903207 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:42:31.015806 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:42:31.266262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:42:31.614595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9635): Launched 10:42:31.908467 run iperf3-srv_10.42.42.10(pid=9636): Launched 10:42:32.031114 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:42:32.302316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:42:32.629098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9637): Launched 10:42:32.911850 run iperf3-srv_10.42.42.10(pid=9638): Launched 10:42:33.033264 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:42:33.251561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:42:33.576439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9639): Launched 10:42:33.858785 run iperf3-srv_10.42.42.10(pid=9640): Launched 10:42:33.981945 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:42:34.199696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:42:34.524154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9641): Launched 10:42:34.806399 run iperf3-srv_10.42.42.10(pid=9642): Launched 10:42:34.929523 tst iperf3m4.py:8: start network... 10:42:35.148037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:35.649734 run create_hlr_db(pid=9643): Launched 10:42:35.783329 bus /gobi_6: Setting Powered False 10:42:36.847196 run create_hlr_db(pid=9643): Terminated: ok {rc=0} 10:42:37.280353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9645): Launched 10:42:37.585226 run osmo-hlr_10.42.42.2(pid=9646): Launched 10:42:37.701373 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:38.235262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9648): Launched 10:42:38.539465 run osmo-stp_10.42.42.5(pid=9649): Launched 10:42:38.655699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:42:39.179307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9651): Launched 10:42:39.297374 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:42:39.553956 run patchelf(pid=9652): Launched 10:42:39.724136 run osmo-stp_10.42.42.5(pid=9649): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9649)] 10:42:39.853092 run osmo-stp_10.42.42.5(pid=9649): stdout: | (launched: 2022-12-14_10:42:38.483240) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:39.983584 run osmo-stp_10.42.42.5(pid=9649): stderr: | 20221214104238649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104238650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104238650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104238650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104238651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104238651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104238651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:40.114374 run osmo-stp_10.42.42.5(pid=9649): stdout: | (launched: 2022-12-14_10:42:38.483240) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:40.238642 run osmo-stp_10.42.42.5(pid=9649): stderr: | 20221214104238649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104238650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104238650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104238650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104238651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104238651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104238651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:40.386041 run patchelf(pid=9652): Terminating (SIGINT) 10:42:40.557410 run patchelf(pid=9652): Terminated: ok {rc=0} 10:42:40.681121 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9649): Process ended prematurely: osmo-stp_10.42.42.5(pid=9649) [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9649)] [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 10:42:40.690669 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:42:40.718662 run osmo-hlr_10.42.42.2(pid=9646): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9646)] 10:42:40.767164 run osmo-hlr_10.42.42.2(pid=9646): stdout: | (launched: 2022-12-14_10:42:37.529081) 10:42:40.816798 run osmo-hlr_10.42.42.2(pid=9646): stderr: | 20221214104237702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104237702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104237702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104237702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104237702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104237703 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104237715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104237726 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104237726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104237726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:40.867230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9635): Terminating (SIGTERM) 10:42:40.907297 run iperf3-srv_10.42.42.10(pid=9636): Terminating (SIGTERM) 10:42:40.947260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9637): Terminating (SIGTERM) 10:42:40.987398 run iperf3-srv_10.42.42.10(pid=9638): Terminating (SIGTERM) 10:42:41.027382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9639): Terminating (SIGTERM) 10:42:41.067461 run iperf3-srv_10.42.42.10(pid=9640): Terminating (SIGTERM) 10:42:41.107384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9641): Terminating (SIGTERM) 10:42:41.147442 run iperf3-srv_10.42.42.10(pid=9642): Terminating (SIGTERM) 10:42:41.187337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9645): Terminating (SIGTERM) 10:42:41.227525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9648): Terminating (SIGTERM) 10:42:41.267538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9651): Terminating (SIGTERM) 10:42:41.307807 --- ParallelTerminationStrategy: PID 9635 died... 10:42:41.327516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9635): Terminated: ok {rc=0} 10:42:41.372298 --- ParallelTerminationStrategy: PID 9636 died... 10:42:41.391351 run iperf3-srv_10.42.42.10(pid=9636): Terminated {rc=256} 10:42:41.435457 --- ParallelTerminationStrategy: PID 9637 died... 10:42:41.454610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9637): Terminated: ok {rc=0} 10:42:41.498844 --- ParallelTerminationStrategy: PID 9638 died... 10:42:41.517934 run iperf3-srv_10.42.42.10(pid=9638): Terminated {rc=256} 10:42:41.562152 --- ParallelTerminationStrategy: PID 9639 died... 10:42:41.581185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9639): Terminated: ok {rc=0} 10:42:41.625552 --- ParallelTerminationStrategy: PID 9640 died... 10:42:41.644465 run iperf3-srv_10.42.42.10(pid=9640): Terminated {rc=256} 10:42:41.688376 --- ParallelTerminationStrategy: PID 9641 died... 10:42:41.707362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9641): Terminated: ok {rc=0} 10:42:41.751586 --- ParallelTerminationStrategy: PID 9642 died... 10:42:41.770564 run iperf3-srv_10.42.42.10(pid=9642): Terminated {rc=256} 10:42:41.814425 --- ParallelTerminationStrategy: PID 9645 died... 10:42:41.833507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9645): Terminated: ok {rc=0} 10:42:41.877613 --- ParallelTerminationStrategy: PID 9648 died... 10:42:41.896638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9648): Terminated: ok {rc=0} 10:42:41.940802 --- ParallelTerminationStrategy: PID 9651 died... 10:42:41.960454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9651): Terminated: ok {rc=0} 10:42:42.045532 bus /gobi_4: Setting Powered False 10:42:43.144123 bus /gobi_4: Setting Powered False 10:42:44.261650 bus /gobi_1: Setting Powered False 10:42:45.358851 bus /gobi_1: Setting Powered False 10:42:46.482879 bus /gobi_0: Setting Powered False 10:42:47.595469 bus /gobi_0: Setting Powered False 10:42:48.713358 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 10:42:49.817900 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:49.829865 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:42:49.881520 tst ping.py: using LAC 40372 10:42:50.005678 tst ping.py: using RAC 82 10:42:50.122582 tst ping.py: using CellId 40372 10:42:50.241301 tst ping.py: using BVCI 40373 10:42:50.350957 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:50.362147 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:50.372688 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:50.383401 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:50.394275 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:50.405350 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:50.416449 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:50.427374 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:42:50.548917 tst ping.py:19: start network... 10:42:50.763389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:51.256326 run create_hlr_db(pid=9653): Launched 10:42:51.387571 bus /gobi_6: Setting Powered False 10:42:52.450927 run create_hlr_db(pid=9653): Terminated: ok {rc=0} 10:42:52.878880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9655): Launched 10:42:53.177699 run osmo-hlr_10.42.42.2(pid=9656): Launched 10:42:53.291379 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:53.825459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9658): Launched 10:42:54.125151 run osmo-stp_10.42.42.5(pid=9659): Launched 10:42:54.239820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:42:54.754991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9661): Launched 10:42:54.870357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:42:55.123861 run patchelf(pid=9662): Launched 10:42:55.290969 run osmo-stp_10.42.42.5(pid=9659): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9659)] 10:42:55.417850 run osmo-stp_10.42.42.5(pid=9659): stdout: | (launched: 2022-12-14_10:42:54.069533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:55.546671 run osmo-stp_10.42.42.5(pid=9659): stderr: | 20221214104254236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104254236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104254236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104254237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104254237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104254237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104254237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:55.675532 run osmo-stp_10.42.42.5(pid=9659): stdout: | (launched: 2022-12-14_10:42:54.069533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:55.798164 run osmo-stp_10.42.42.5(pid=9659): stderr: | 20221214104254236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104254236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104254236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104254237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104254237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104254237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104254237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:55.943810 run patchelf(pid=9662): Terminating (SIGINT) 10:42:56.112152 run patchelf(pid=9662): Terminated: ok {rc=0} 10:42:56.233564 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9659): Process ended prematurely: osmo-stp_10.42.42.5(pid=9659) [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9659)] [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 10:42:56.242623 tst ping.py:22: Test FAILED (6.4 sec) 10:42:56.269511 run osmo-hlr_10.42.42.2(pid=9656): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9656)] 10:42:56.318156 run osmo-hlr_10.42.42.2(pid=9656): stdout: | (launched: 2022-12-14_10:42:53.122622) 10:42:56.368082 run osmo-hlr_10.42.42.2(pid=9656): stderr: | 20221214104253295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104253295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104253295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104253295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104253295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104253295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104253308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104253318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104253318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104253318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:56.418303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9655): Terminating (SIGTERM) 10:42:56.458602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9658): Terminating (SIGTERM) 10:42:56.498694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9661): Terminating (SIGTERM) 10:42:56.539004 --- ParallelTerminationStrategy: PID 9655 died... 10:42:56.558766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9655): Terminated: ok {rc=0} 10:42:56.603346 --- ParallelTerminationStrategy: PID 9658 died... 10:42:56.622646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9658): Terminated: ok {rc=0} 10:42:56.666963 --- ParallelTerminationStrategy: PID 9661 died... 10:42:56.686225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9661): Terminated: ok {rc=0} 10:42:56.773924 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:42:57.862666 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:57.874461 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:42:57.925464 tst ping_idle_ping.py: using LAC 40373 10:42:58.044791 tst ping_idle_ping.py: using RAC 83 10:42:58.162743 tst ping_idle_ping.py: using CellId 40373 10:42:58.281749 tst ping_idle_ping.py: using BVCI 40374 10:42:58.398178 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:58.409862 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:58.421304 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:58.432597 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:58.443859 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:58.455128 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:58.466459 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:42:58.477679 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:42:58.594299 tst ping_idle_ping.py:24: start network... 10:42:58.795691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:59.260135 run create_hlr_db(pid=9663): Launched 10:42:59.375610 bus /gobi_6: Setting Powered False 10:43:00.435534 run create_hlr_db(pid=9663): Terminated: ok {rc=0} 10:43:00.901709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9665): Launched 10:43:01.245841 run osmo-hlr_10.42.42.2(pid=9666): Launched 10:43:01.534447 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:02.136765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9668): Launched 10:43:02.465331 run osmo-stp_10.42.42.5(pid=9669): Launched 10:43:02.583383 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:43:03.100577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9671): Launched 10:43:03.215344 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:43:03.468055 run patchelf(pid=9672): Launched 10:43:03.635161 run osmo-stp_10.42.42.5(pid=9669): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9669)] 10:43:03.762349 run osmo-stp_10.42.42.5(pid=9669): stdout: | (launched: 2022-12-14_10:43:02.409803) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:03.891980 run osmo-stp_10.42.42.5(pid=9669): stderr: | 20221214104302577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104302578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104302578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104302578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104302579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104302579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104302579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:04.021335 run osmo-stp_10.42.42.5(pid=9669): stdout: | (launched: 2022-12-14_10:43:02.409803) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:04.144390 run osmo-stp_10.42.42.5(pid=9669): stderr: | 20221214104302577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104302578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104302578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104302578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104302579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104302579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104302579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:04.289621 run patchelf(pid=9672): Terminating (SIGINT) 10:43:04.458263 run patchelf(pid=9672): Terminated: ok {rc=0} 10:43:04.579731 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9669): Process ended prematurely: osmo-stp_10.42.42.5(pid=9669) [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9669)] [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 10:43:04.588815 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:43:04.615866 run osmo-hlr_10.42.42.2(pid=9666): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9666)] 10:43:04.664303 run osmo-hlr_10.42.42.2(pid=9666): stdout: | (launched: 2022-12-14_10:43:01.183138) 10:43:04.714162 run osmo-hlr_10.42.42.2(pid=9666): stderr: | 20221214104301426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104301426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104301426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104301426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104301426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104301426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104301443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104301459 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104301459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104301459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:04.764218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9665): Terminating (SIGTERM) 10:43:04.804572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9668): Terminating (SIGTERM) 10:43:04.844804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9671): Terminating (SIGTERM) 10:43:04.885432 --- ParallelTerminationStrategy: PID 9665 died... 10:43:04.905362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9665): Terminated: ok {rc=0} 10:43:04.949610 --- ParallelTerminationStrategy: PID 9668 died... 10:43:04.968561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9668): Terminated: ok {rc=0} 10:43:05.012605 --- ParallelTerminationStrategy: PID 9671 died... 10:43:05.031603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9671): Terminated: ok {rc=0} 10:43:05.115661 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:43:06.421071 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:06.428041 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:43:06.462575 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:43:06.502477 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:43:06.592279 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:43:06.626198 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:43:06.665510 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:43:07.259846 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:43:07.311962 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:07.323298 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:43:07.394651 tst cs_paging_gprs_active.py: using LAC 40374 10:43:07.523776 tst cs_paging_gprs_active.py: using RAC 84 10:43:07.651615 tst cs_paging_gprs_active.py: using CellId 40374 10:43:07.778958 tst cs_paging_gprs_active.py: using BVCI 40375 10:43:07.897572 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:07.908829 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:07.920214 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:07.931600 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:07.942873 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:07.954120 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:07.965392 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:07.976454 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:07.987945 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:43:08.109595 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:43:08.229298 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:43:08.434569 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:43:08.742997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9676): Launched 10:43:09.010995 run iperf3-srv_10.42.42.10(pid=9677): Launched 10:43:09.126399 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:43:09.330695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:43:09.637964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9678): Launched 10:43:09.907496 run iperf3-srv_10.42.42.10(pid=9679): Launched 10:43:10.023434 tst cs_paging_gprs_active.py:38: start network... 10:43:10.228315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:10.701601 run create_hlr_db(pid=9680): Launched 10:43:10.820080 bus /gobi_6: Setting Powered False 10:43:11.880529 run create_hlr_db(pid=9680): Terminated: ok {rc=0} 10:43:12.308039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9682): Launched 10:43:12.614536 run osmo-hlr_10.42.42.2(pid=9683): Launched 10:43:12.730692 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:13.256037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9685): Launched 10:43:13.583192 run osmo-stp_10.42.42.5(pid=9686): Launched 10:43:13.706848 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:43:14.266867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9688): Launched 10:43:14.392470 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:43:14.674292 run patchelf(pid=9689): Launched 10:43:14.856421 run osmo-stp_10.42.42.5(pid=9686): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9686)] 10:43:14.995256 run osmo-stp_10.42.42.5(pid=9686): stdout: | (launched: 2022-12-14_10:43:13.523144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:15.135012 run osmo-stp_10.42.42.5(pid=9686): stderr: | 20221214104313713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104313713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104313713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104313714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104313714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104313714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104313714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:15.274706 run osmo-stp_10.42.42.5(pid=9686): stdout: | (launched: 2022-12-14_10:43:13.523144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:15.407605 run osmo-stp_10.42.42.5(pid=9686): stderr: | 20221214104313713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104313713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104313713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104313714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104313714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104313714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104313714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:15.565610 run patchelf(pid=9689): Terminating (SIGINT) 10:43:15.749183 run patchelf(pid=9689): Terminated: ok {rc=0} 10:43:15.908527 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9686): Process ended prematurely: osmo-stp_10.42.42.5(pid=9686) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9686)] [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:43:15.920027 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:43:15.949664 run osmo-hlr_10.42.42.2(pid=9683): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9683)] 10:43:16.001307 run osmo-hlr_10.42.42.2(pid=9683): stdout: | (launched: 2022-12-14_10:43:12.558030) 10:43:16.054194 run osmo-hlr_10.42.42.2(pid=9683): stderr: | 20221214104312733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104312733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104312733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104312733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104312733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104312733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104312746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104312754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104312754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104312754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:16.108199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9676): Terminating (SIGTERM) 10:43:16.153038 run iperf3-srv_10.42.42.10(pid=9677): Terminating (SIGTERM) 10:43:16.198955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9678): Terminating (SIGTERM) 10:43:16.242712 run iperf3-srv_10.42.42.10(pid=9679): Terminating (SIGTERM) 10:43:16.288463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9682): Terminating (SIGTERM) 10:43:16.332385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9685): Terminating (SIGTERM) 10:43:16.376100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9688): Terminating (SIGTERM) 10:43:16.422181 --- ParallelTerminationStrategy: PID 9676 died... 10:43:16.443000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9676): Terminated: ok {rc=0} 10:43:16.490392 --- ParallelTerminationStrategy: PID 9677 died... 10:43:16.510560 run iperf3-srv_10.42.42.10(pid=9677): Terminated {rc=256} 10:43:16.557862 --- ParallelTerminationStrategy: PID 9678 died... 10:43:16.578176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9678): Terminated: ok {rc=0} 10:43:16.625465 --- ParallelTerminationStrategy: PID 9679 died... 10:43:16.645706 run iperf3-srv_10.42.42.10(pid=9679): Terminated {rc=256} 10:43:16.692676 --- ParallelTerminationStrategy: PID 9682 died... 10:43:16.713108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9682): Terminated: ok {rc=0} 10:43:16.759993 --- ParallelTerminationStrategy: PID 9685 died... 10:43:16.780307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9685): Terminated: ok {rc=0} 10:43:16.827507 --- ParallelTerminationStrategy: PID 9688 died... 10:43:16.847748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9688): Terminated: ok {rc=0} 10:43:16.937788 bus /gobi_0: Setting Powered False 10:43:18.039084 bus /gobi_0: Setting Powered False 10:43:19.153056 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:43:20.302419 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:20.314468 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:43:20.391530 tst iperf3.py: using LAC 40375 10:43:20.517483 tst iperf3.py: using RAC 85 10:43:20.642064 tst iperf3.py: using CellId 40375 10:43:20.766984 tst iperf3.py: using BVCI 40376 10:43:20.884089 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:20.895598 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:20.907351 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:20.918582 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:20.929797 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:20.940822 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:20.952187 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:20.963219 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:20.974561 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:43:21.094690 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:43:21.313844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:43:21.639116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9690): Launched 10:43:21.924602 run iperf3-srv_10.42.42.10(pid=9691): Launched 10:43:22.046756 tst iperf3.py:8: start network... 10:43:22.265222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:22.767512 run create_hlr_db(pid=9692): Launched 10:43:22.900104 bus /gobi_6: Setting Powered False 10:43:23.964866 run create_hlr_db(pid=9692): Terminated: ok {rc=0} 10:43:24.401568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9694): Launched 10:43:24.707184 run osmo-hlr_10.42.42.2(pid=9695): Launched 10:43:24.823619 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:25.354301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9697): Launched 10:43:25.661436 run osmo-stp_10.42.42.5(pid=9698): Launched 10:43:25.778256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:43:26.305797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9700): Launched 10:43:26.423413 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:43:26.681612 run patchelf(pid=9701): Launched 10:43:26.852699 run osmo-stp_10.42.42.5(pid=9698): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9698)] 10:43:26.982107 run osmo-stp_10.42.42.5(pid=9698): stdout: | (launched: 2022-12-14_10:43:25.605233) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:27.113146 run osmo-stp_10.42.42.5(pid=9698): stderr: | 20221214104325775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104325775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104325775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104325776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104325776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104325776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104325776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:27.244318 run osmo-stp_10.42.42.5(pid=9698): stdout: | (launched: 2022-12-14_10:43:25.605233) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:27.369605 run osmo-stp_10.42.42.5(pid=9698): stderr: | 20221214104325775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104325775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104325775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104325776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104325776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104325776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104325776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:27.517907 run patchelf(pid=9701): Terminating (SIGINT) 10:43:27.689802 run patchelf(pid=9701): Terminated: ok {rc=0} 10:43:27.813666 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9698): Process ended prematurely: osmo-stp_10.42.42.5(pid=9698) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9698)] [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 10:43:27.823373 tst iperf3.py:8: Test FAILED (7.6 sec) 10:43:27.850826 run osmo-hlr_10.42.42.2(pid=9695): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9695)] 10:43:27.899032 run osmo-hlr_10.42.42.2(pid=9695): stdout: | (launched: 2022-12-14_10:43:24.651036) 10:43:27.949199 run osmo-hlr_10.42.42.2(pid=9695): stderr: | 20221214104324825 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104324825 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104324825 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104324825 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104324825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104324825 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104324838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104324847 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104324847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104324847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:27.999323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9690): Terminating (SIGTERM) 10:43:28.039832 run iperf3-srv_10.42.42.10(pid=9691): Terminating (SIGTERM) 10:43:28.080316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9694): Terminating (SIGTERM) 10:43:28.120939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9697): Terminating (SIGTERM) 10:43:28.161406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9700): Terminating (SIGTERM) 10:43:28.202129 --- ParallelTerminationStrategy: PID 9690 died... 10:43:28.222057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9690): Terminated: ok {rc=0} 10:43:28.266252 --- ParallelTerminationStrategy: PID 9691 died... 10:43:28.285287 run iperf3-srv_10.42.42.10(pid=9691): Terminated {rc=256} 10:43:28.329257 --- ParallelTerminationStrategy: PID 9694 died... 10:43:28.348278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9694): Terminated: ok {rc=0} 10:43:28.391990 --- ParallelTerminationStrategy: PID 9697 died... 10:43:28.410986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9697): Terminated: ok {rc=0} 10:43:28.454819 --- ParallelTerminationStrategy: PID 9700 died... 10:43:28.473865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9700): Terminated: ok {rc=0} 10:43:28.560224 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:43:29.708759 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:29.720532 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:43:29.792773 tst iperf3m4.py: using LAC 40376 10:43:29.913853 tst iperf3m4.py: using RAC 86 10:43:30.033394 tst iperf3m4.py: using CellId 40376 10:43:30.159198 tst iperf3m4.py: using BVCI 40377 10:43:30.277122 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:30.288763 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:30.300283 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:30.311759 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:30.323272 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:30.334727 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:30.346414 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:30.357556 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:30.368756 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:43:30.488078 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:43:30.608315 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:43:30.727776 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:43:30.851253 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:43:31.086792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:43:31.425700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9702): Launched 10:43:31.708314 run iperf3-srv_10.42.42.10(pid=9703): Launched 10:43:31.846768 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:43:32.071104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:43:32.402489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9704): Launched 10:43:32.686824 run iperf3-srv_10.42.42.10(pid=9705): Launched 10:43:32.809908 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:43:33.026737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:43:33.352748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9706): Launched 10:43:33.637433 run iperf3-srv_10.42.42.10(pid=9707): Launched 10:43:33.760559 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:43:33.977908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:43:34.304795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9708): Launched 10:43:34.587945 run iperf3-srv_10.42.42.10(pid=9709): Launched 10:43:34.711117 tst iperf3m4.py:8: start network... 10:43:34.928608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:35.433130 run create_hlr_db(pid=9710): Launched 10:43:35.566940 bus /gobi_6: Setting Powered False 10:43:36.630941 run create_hlr_db(pid=9710): Terminated: ok {rc=0} 10:43:37.067106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9712): Launched 10:43:37.373303 run osmo-hlr_10.42.42.2(pid=9713): Launched 10:43:37.490445 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:38.025945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9715): Launched 10:43:38.332672 run osmo-stp_10.42.42.5(pid=9716): Launched 10:43:38.448628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:43:38.973213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9718): Launched 10:43:39.090113 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:43:39.346971 run patchelf(pid=9719): Launched 10:43:39.518483 run osmo-stp_10.42.42.5(pid=9716): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9716)] 10:43:39.647569 run osmo-stp_10.42.42.5(pid=9716): stdout: | (launched: 2022-12-14_10:43:38.275686) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:39.778363 run osmo-stp_10.42.42.5(pid=9716): stderr: | 20221214104338446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104338446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104338446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104338447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104338447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104338447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104338447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:39.908409 run osmo-stp_10.42.42.5(pid=9716): stdout: | (launched: 2022-12-14_10:43:38.275686) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:40.033221 run osmo-stp_10.42.42.5(pid=9716): stderr: | 20221214104338446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104338446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104338446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104338447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104338447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104338447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104338447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:40.181142 run patchelf(pid=9719): Terminating (SIGINT) 10:43:40.352736 run patchelf(pid=9719): Terminated: ok {rc=0} 10:43:40.476772 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9716): Process ended prematurely: osmo-stp_10.42.42.5(pid=9716) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9716)] [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:43:40.486546 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:43:40.514256 run osmo-hlr_10.42.42.2(pid=9713): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9713)] 10:43:40.563107 run osmo-hlr_10.42.42.2(pid=9713): stdout: | (launched: 2022-12-14_10:43:37.316543) 10:43:40.613166 run osmo-hlr_10.42.42.2(pid=9713): stderr: | 20221214104337489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104337489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104337489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104337489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104337489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104337489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104337502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104337510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104337511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104337511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:40.663248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9702): Terminating (SIGTERM) 10:43:40.704147 run iperf3-srv_10.42.42.10(pid=9703): Terminating (SIGTERM) 10:43:40.744742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9704): Terminating (SIGTERM) 10:43:40.785632 run iperf3-srv_10.42.42.10(pid=9705): Terminating (SIGTERM) 10:43:40.826373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9706): Terminating (SIGTERM) 10:43:40.867079 run iperf3-srv_10.42.42.10(pid=9707): Terminating (SIGTERM) 10:43:40.907461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9708): Terminating (SIGTERM) 10:43:40.947976 run iperf3-srv_10.42.42.10(pid=9709): Terminating (SIGTERM) 10:43:40.988374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9712): Terminating (SIGTERM) 10:43:41.029029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9715): Terminating (SIGTERM) 10:43:41.069470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9718): Terminating (SIGTERM) 10:43:41.110343 --- ParallelTerminationStrategy: PID 9702 died... 10:43:41.130320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9702): Terminated: ok {rc=0} 10:43:41.175248 --- ParallelTerminationStrategy: PID 9703 died... 10:43:41.194351 run iperf3-srv_10.42.42.10(pid=9703): Terminated {rc=256} 10:43:41.239157 --- ParallelTerminationStrategy: PID 9704 died... 10:43:41.258888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9704): Terminated: ok {rc=0} 10:43:41.303579 --- ParallelTerminationStrategy: PID 9705 died... 10:43:41.322832 run iperf3-srv_10.42.42.10(pid=9705): Terminated {rc=256} 10:43:41.367337 --- ParallelTerminationStrategy: PID 9706 died... 10:43:41.386685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9706): Terminated: ok {rc=0} 10:43:41.431511 --- ParallelTerminationStrategy: PID 9707 died... 10:43:41.450766 run iperf3-srv_10.42.42.10(pid=9707): Terminated {rc=256} 10:43:41.495296 --- ParallelTerminationStrategy: PID 9708 died... 10:43:41.514671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9708): Terminated: ok {rc=0} 10:43:41.559329 --- ParallelTerminationStrategy: PID 9709 died... 10:43:41.578766 run iperf3-srv_10.42.42.10(pid=9709): Terminated {rc=256} 10:43:41.623345 --- ParallelTerminationStrategy: PID 9712 died... 10:43:41.642742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9712): Terminated: ok {rc=0} 10:43:41.687456 --- ParallelTerminationStrategy: PID 9715 died... 10:43:41.706733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9715): Terminated: ok {rc=0} 10:43:41.751423 --- ParallelTerminationStrategy: PID 9718 died... 10:43:41.770769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9718): Terminated: ok {rc=0} 10:43:41.856232 bus /gobi_4: Setting Powered False 10:43:42.954189 bus /gobi_4: Setting Powered False 10:43:44.069818 bus /gobi_1: Setting Powered False 10:43:45.168461 bus /gobi_1: Setting Powered False 10:43:46.287873 bus /gobi_0: Setting Powered False 10:43:47.391720 bus /gobi_0: Setting Powered False 10:43:48.509996 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:43:49.613436 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:49.625382 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:43:49.704685 tst ping.py: using LAC 40377 10:43:49.827767 tst ping.py: using RAC 87 10:43:49.950653 tst ping.py: using CellId 40377 10:43:50.076789 tst ping.py: using BVCI 40378 10:43:50.193604 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:50.204913 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:50.216201 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:50.227463 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:50.238591 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:50.249897 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:50.261250 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:50.272569 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:43:50.388717 tst ping.py:19: start network... 10:43:50.588676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:51.049542 run create_hlr_db(pid=9720): Launched 10:43:51.165393 bus /gobi_6: Setting Powered False 10:43:52.225686 run create_hlr_db(pid=9720): Terminated: ok {rc=0} 10:43:52.645344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9722): Launched 10:43:52.946027 run osmo-hlr_10.42.42.2(pid=9723): Launched 10:43:53.060522 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:53.578707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9725): Launched 10:43:53.879262 run osmo-stp_10.42.42.5(pid=9726): Launched 10:43:53.992867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:43:54.506532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9728): Launched 10:43:54.621308 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:43:54.873891 run patchelf(pid=9729): Launched 10:43:55.040725 run osmo-stp_10.42.42.5(pid=9726): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9726)] 10:43:55.167523 run osmo-stp_10.42.42.5(pid=9726): stdout: | (launched: 2022-12-14_10:43:53.823833) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:55.295669 run osmo-stp_10.42.42.5(pid=9726): stderr: | 20221214104353992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104353992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104353993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104353993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104353994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104353994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104353994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:55.423944 run osmo-stp_10.42.42.5(pid=9726): stdout: | (launched: 2022-12-14_10:43:53.823833) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:55.546300 run osmo-stp_10.42.42.5(pid=9726): stderr: | 20221214104353992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104353992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104353993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104353993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104353994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104353994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104353994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:55.690930 run patchelf(pid=9729): Terminating (SIGINT) 10:43:55.859433 run patchelf(pid=9729): Terminated: ok {rc=0} 10:43:55.980694 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9726): Process ended prematurely: osmo-stp_10.42.42.5(pid=9726) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9726)] [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 10:43:55.989951 tst ping.py:22: Test FAILED (6.4 sec) 10:43:56.016807 run osmo-hlr_10.42.42.2(pid=9723): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9723)] 10:43:56.065415 run osmo-hlr_10.42.42.2(pid=9723): stdout: | (launched: 2022-12-14_10:43:52.890423) 10:43:56.115678 run osmo-hlr_10.42.42.2(pid=9723): stderr: | 20221214104353063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104353063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104353063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104353063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104353063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104353063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104353075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104353083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104353083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104353084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:56.166243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9722): Terminating (SIGTERM) 10:43:56.206810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9725): Terminating (SIGTERM) 10:43:56.247202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9728): Terminating (SIGTERM) 10:43:56.287940 --- ParallelTerminationStrategy: PID 9722 died... 10:43:56.308199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9722): Terminated: ok {rc=0} 10:43:56.353196 --- ParallelTerminationStrategy: PID 9725 died... 10:43:56.372372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9725): Terminated: ok {rc=0} 10:43:56.416842 --- ParallelTerminationStrategy: PID 9728 died... 10:43:56.436734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9728): Terminated: ok {rc=0} 10:43:56.523544 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:43:57.613550 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:57.625753 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:43:57.699013 tst ping_idle_ping.py: using LAC 40378 10:43:57.817801 tst ping_idle_ping.py: using RAC 88 10:43:57.937745 tst ping_idle_ping.py: using CellId 40378 10:43:58.066652 tst ping_idle_ping.py: using BVCI 40379 10:43:58.185689 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:58.197391 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:58.208815 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:58.220257 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:58.232161 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:58.243912 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:58.255675 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:43:58.267413 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:43:58.383808 tst ping_idle_ping.py:24: start network... 10:43:58.585209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:59.053693 run create_hlr_db(pid=9730): Launched 10:43:59.169497 bus /gobi_6: Setting Powered False 10:44:00.230447 run create_hlr_db(pid=9730): Terminated: ok {rc=0} 10:44:00.672685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9732): Launched 10:44:01.024681 run osmo-hlr_10.42.42.2(pid=9733): Launched 10:44:01.329735 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:01.905641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9735): Launched 10:44:02.225858 run osmo-stp_10.42.42.5(pid=9736): Launched 10:44:02.386447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:44:02.908418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9738): Launched 10:44:03.024232 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:44:03.278398 run patchelf(pid=9739): Launched 10:44:03.446247 run osmo-stp_10.42.42.5(pid=9736): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9736)] 10:44:03.574541 run osmo-stp_10.42.42.5(pid=9736): stdout: | (launched: 2022-12-14_10:44:02.167778) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:03.704307 run osmo-stp_10.42.42.5(pid=9736): stderr: | 20221214104402435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104402435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104402435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104402435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104402436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104402436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104402436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:03.834301 run osmo-stp_10.42.42.5(pid=9736): stdout: | (launched: 2022-12-14_10:44:02.167778) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:03.957710 run osmo-stp_10.42.42.5(pid=9736): stderr: | 20221214104402435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104402435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104402435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104402435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104402436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104402436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104402436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:04.103792 run patchelf(pid=9739): Terminating (SIGINT) 10:44:04.273984 run patchelf(pid=9739): Terminated: ok {rc=0} 10:44:04.396909 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9736): Process ended prematurely: osmo-stp_10.42.42.5(pid=9736) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9736)] [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:44:04.406267 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:44:04.433224 run osmo-hlr_10.42.42.2(pid=9733): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9733)] 10:44:04.482185 run osmo-hlr_10.42.42.2(pid=9733): stdout: | (launched: 2022-12-14_10:44:00.965357) 10:44:04.532604 run osmo-hlr_10.42.42.2(pid=9733): stderr: | 20221214104401183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104401183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104401183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104401183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104401183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104401184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104401200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104401216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104401216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104401216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:04.583398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9732): Terminating (SIGTERM) 10:44:04.624191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9735): Terminating (SIGTERM) 10:44:04.665726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9738): Terminating (SIGTERM) 10:44:04.707666 --- ParallelTerminationStrategy: PID 9732 died... 10:44:04.727936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9732): Terminated: ok {rc=0} 10:44:04.773132 --- ParallelTerminationStrategy: PID 9735 died... 10:44:04.792506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9735): Terminated: ok {rc=0} 10:44:04.837182 --- ParallelTerminationStrategy: PID 9738 died... 10:44:04.856439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9738): Terminated: ok {rc=0} 10:44:04.944227 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:44:06.247578 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:44:06.253589 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:44:06.286114 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:44:06.324488 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:44:06.411269 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:44:06.443862 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:44:06.482094 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:44:07.074366 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:44:07.124254 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:07.135153 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:44:07.205756 tst cs_paging_gprs_active.py: using LAC 40379 10:44:07.334772 tst cs_paging_gprs_active.py: using RAC 89 10:44:07.467437 tst cs_paging_gprs_active.py: using CellId 40379 10:44:07.594166 tst cs_paging_gprs_active.py: using BVCI 40380 10:44:07.711695 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:07.723194 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:07.734397 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:07.745555 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:07.756571 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:07.767784 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:07.779031 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:07.790207 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:07.801552 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:44:07.923910 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:44:08.048346 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:44:08.253200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:08.559873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9746): Launched 10:44:08.827095 run iperf3-srv_10.42.42.10(pid=9747): Launched 10:44:08.942769 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:44:09.146876 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:09.452243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9748): Launched 10:44:09.718586 run iperf3-srv_10.42.42.10(pid=9749): Launched 10:44:09.833324 tst cs_paging_gprs_active.py:38: start network... 10:44:10.036313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:10.507909 run create_hlr_db(pid=9750): Launched 10:44:10.625269 bus /gobi_6: Setting Powered False 10:44:11.686358 run create_hlr_db(pid=9750): Terminated: ok {rc=0} 10:44:12.132711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9752): Launched 10:44:12.459354 run osmo-hlr_10.42.42.2(pid=9753): Launched 10:44:12.585842 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:13.144822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9755): Launched 10:44:13.472794 run osmo-stp_10.42.42.5(pid=9756): Launched 10:44:13.597710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:44:14.158276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9758): Launched 10:44:14.283081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:44:14.559180 run patchelf(pid=9759): Launched 10:44:14.743336 run osmo-stp_10.42.42.5(pid=9756): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9756)] 10:44:14.881607 run osmo-stp_10.42.42.5(pid=9756): stdout: | (launched: 2022-12-14_10:44:13.412840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:15.020024 run osmo-stp_10.42.42.5(pid=9756): stderr: | 20221214104413603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104413603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104413604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104413604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104413604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104413605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104413605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:15.159755 run osmo-stp_10.42.42.5(pid=9756): stdout: | (launched: 2022-12-14_10:44:13.412840) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:15.292367 run osmo-stp_10.42.42.5(pid=9756): stderr: | 20221214104413603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104413603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104413604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104413604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104413604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104413605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104413605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:15.450425 run patchelf(pid=9759): Terminating (SIGINT) 10:44:15.633131 run patchelf(pid=9759): Terminated: ok {rc=0} 10:44:15.764198 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9756): Process ended prematurely: osmo-stp_10.42.42.5(pid=9756) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9756)] [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:44:15.774505 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:44:15.803198 run osmo-hlr_10.42.42.2(pid=9753): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9753)] 10:44:15.863079 run osmo-hlr_10.42.42.2(pid=9753): stdout: | (launched: 2022-12-14_10:44:12.399428) 10:44:15.931572 run osmo-hlr_10.42.42.2(pid=9753): stderr: | 20221214104412596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104412596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104412596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104412597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104412597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104412597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104412613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104412623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104412623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104412623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:15.985862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9746): Terminating (SIGTERM) 10:44:16.029558 run iperf3-srv_10.42.42.10(pid=9747): Terminating (SIGTERM) 10:44:16.074690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9748): Terminating (SIGTERM) 10:44:16.118416 run iperf3-srv_10.42.42.10(pid=9749): Terminating (SIGTERM) 10:44:16.162387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9752): Terminating (SIGTERM) 10:44:16.206049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9755): Terminating (SIGTERM) 10:44:16.250828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9758): Terminating (SIGTERM) 10:44:16.296485 --- ParallelTerminationStrategy: PID 9746 died... 10:44:16.319302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9746): Terminated: ok {rc=0} 10:44:16.367853 --- ParallelTerminationStrategy: PID 9747 died... 10:44:16.389589 run iperf3-srv_10.42.42.10(pid=9747): Terminated {rc=256} 10:44:16.436370 --- ParallelTerminationStrategy: PID 9748 died... 10:44:16.457960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9748): Terminated: ok {rc=0} 10:44:16.511231 --- ParallelTerminationStrategy: PID 9749 died... 10:44:16.538405 run iperf3-srv_10.42.42.10(pid=9749): Terminated {rc=256} 10:44:16.597763 --- ParallelTerminationStrategy: PID 9752 died... 10:44:16.621615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9752): Terminated: ok {rc=0} 10:44:16.679496 --- ParallelTerminationStrategy: PID 9755 died... 10:44:16.701090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9755): Terminated: ok {rc=0} 10:44:16.748706 --- ParallelTerminationStrategy: PID 9758 died... 10:44:16.770091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9758): Terminated: ok {rc=0} 10:44:16.860635 bus /gobi_0: Setting Powered False 10:44:17.963348 bus /gobi_0: Setting Powered False 10:44:19.083205 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:44:20.235134 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:20.247096 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:44:20.324362 tst iperf3.py: using LAC 40380 10:44:20.450768 tst iperf3.py: using RAC 90 10:44:20.577901 tst iperf3.py: using CellId 40380 10:44:20.702751 tst iperf3.py: using BVCI 40381 10:44:20.820207 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:20.831574 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:20.842769 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:20.853935 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:20.864912 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:20.876112 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:20.887343 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:20.898390 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:20.910029 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:44:21.026881 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:44:21.231757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:21.538488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9760): Launched 10:44:21.806710 run iperf3-srv_10.42.42.10(pid=9761): Launched 10:44:21.921912 tst iperf3.py:8: start network... 10:44:22.124934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:22.599126 run create_hlr_db(pid=9762): Launched 10:44:22.719029 bus /gobi_6: Setting Powered False 10:44:23.779765 run create_hlr_db(pid=9762): Terminated: ok {rc=0} 10:44:24.227219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9764): Launched 10:44:24.555396 run osmo-hlr_10.42.42.2(pid=9765): Launched 10:44:24.681732 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:25.243958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9767): Launched 10:44:25.570443 run osmo-stp_10.42.42.5(pid=9768): Launched 10:44:25.695380 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:44:26.255410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9770): Launched 10:44:26.382050 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:44:26.657671 run patchelf(pid=9771): Launched 10:44:26.840241 run osmo-stp_10.42.42.5(pid=9768): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9768)] 10:44:26.977666 run osmo-stp_10.42.42.5(pid=9768): stdout: | (launched: 2022-12-14_10:44:25.510497) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:27.116756 run osmo-stp_10.42.42.5(pid=9768): stderr: | 20221214104425703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104425703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104425703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104425703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104425704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104425704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104425704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:27.256319 run osmo-stp_10.42.42.5(pid=9768): stdout: | (launched: 2022-12-14_10:44:25.510497) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:27.389389 run osmo-stp_10.42.42.5(pid=9768): stderr: | 20221214104425703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104425703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104425703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104425703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104425704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104425704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104425704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:27.546603 run patchelf(pid=9771): Terminating (SIGINT) 10:44:27.729043 run patchelf(pid=9771): Terminated: ok {rc=0} 10:44:27.860833 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9768): Process ended prematurely: osmo-stp_10.42.42.5(pid=9768) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9768)] [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 10:44:27.871109 tst iperf3.py:8: Test FAILED (7.7 sec) 10:44:27.900063 run osmo-hlr_10.42.42.2(pid=9765): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9765)] 10:44:27.950546 run osmo-hlr_10.42.42.2(pid=9765): stdout: | (launched: 2022-12-14_10:44:24.495255) 10:44:28.002820 run osmo-hlr_10.42.42.2(pid=9765): stderr: | 20221214104424691 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104424691 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104424691 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104424691 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104424691 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104424691 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104424707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104424716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104424716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104424716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:28.055589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9760): Terminating (SIGTERM) 10:44:28.098519 run iperf3-srv_10.42.42.10(pid=9761): Terminating (SIGTERM) 10:44:28.141422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9764): Terminating (SIGTERM) 10:44:28.183894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9767): Terminating (SIGTERM) 10:44:28.226666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9770): Terminating (SIGTERM) 10:44:28.269607 --- ParallelTerminationStrategy: PID 9760 died... 10:44:28.290125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9760): Terminated: ok {rc=0} 10:44:28.337109 --- ParallelTerminationStrategy: PID 9761 died... 10:44:28.357246 run iperf3-srv_10.42.42.10(pid=9761): Terminated {rc=256} 10:44:28.403889 --- ParallelTerminationStrategy: PID 9764 died... 10:44:28.424050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9764): Terminated: ok {rc=0} 10:44:28.470830 --- ParallelTerminationStrategy: PID 9767 died... 10:44:28.490774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9767): Terminated: ok {rc=0} 10:44:28.537421 --- ParallelTerminationStrategy: PID 9770 died... 10:44:28.557522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9770): Terminated: ok {rc=0} 10:44:28.646333 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:44:29.791928 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:29.803583 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:44:29.879538 tst iperf3m4.py: using LAC 40381 10:44:30.007227 tst iperf3m4.py: using RAC 91 10:44:30.133716 tst iperf3m4.py: using CellId 40381 10:44:30.253980 tst iperf3m4.py: using BVCI 40382 10:44:30.366844 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:30.377993 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:30.388863 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:30.399791 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:30.410969 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:30.422056 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:30.433217 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:30.444069 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:30.455234 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:44:30.573805 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:44:30.695901 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:44:30.817565 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:44:30.954186 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:44:31.176236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:31.517742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9772): Launched 10:44:31.829156 run iperf3-srv_10.42.42.10(pid=9773): Launched 10:44:31.994488 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:44:32.204632 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:32.516598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9774): Launched 10:44:32.783799 run iperf3-srv_10.42.42.10(pid=9775): Launched 10:44:32.899544 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:44:33.103695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:33.410418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9776): Launched 10:44:33.679149 run iperf3-srv_10.42.42.10(pid=9777): Launched 10:44:33.795665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:44:33.999853 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:34.306470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9778): Launched 10:44:34.575354 run iperf3-srv_10.42.42.10(pid=9779): Launched 10:44:34.692057 tst iperf3m4.py:8: start network... 10:44:34.895612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:35.370424 run create_hlr_db(pid=9780): Launched 10:44:35.488810 bus /gobi_6: Setting Powered False 10:44:36.549621 run create_hlr_db(pid=9780): Terminated: ok {rc=0} 10:44:36.996238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9782): Launched 10:44:37.323447 run osmo-hlr_10.42.42.2(pid=9783): Launched 10:44:37.449553 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:38.015260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9785): Launched 10:44:38.343568 run osmo-stp_10.42.42.5(pid=9786): Launched 10:44:38.467701 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:44:39.027713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9788): Launched 10:44:39.154516 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:44:39.429934 run patchelf(pid=9789): Launched 10:44:39.611185 run osmo-stp_10.42.42.5(pid=9786): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9786)] 10:44:39.748905 run osmo-stp_10.42.42.5(pid=9786): stdout: | (launched: 2022-12-14_10:44:38.283582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:39.888106 run osmo-stp_10.42.42.5(pid=9786): stderr: | 20221214104438473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104438473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104438473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104438474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104438474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104438474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104438475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:40.027347 run osmo-stp_10.42.42.5(pid=9786): stdout: | (launched: 2022-12-14_10:44:38.283582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:40.161240 run osmo-stp_10.42.42.5(pid=9786): stderr: | 20221214104438473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104438473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104438473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104438474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104438474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104438474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104438475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:40.318555 run patchelf(pid=9789): Terminating (SIGINT) 10:44:40.500793 run patchelf(pid=9789): Terminated: ok {rc=0} 10:44:40.632438 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9786): Process ended prematurely: osmo-stp_10.42.42.5(pid=9786) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9786)] [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:44:40.642876 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:44:40.672477 run osmo-hlr_10.42.42.2(pid=9783): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9783)] 10:44:40.722995 run osmo-hlr_10.42.42.2(pid=9783): stdout: | (launched: 2022-12-14_10:44:37.263737) 10:44:40.775451 run osmo-hlr_10.42.42.2(pid=9783): stderr: | 20221214104437457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104437457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104437457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104437457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104437457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104437458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104437470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104437478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104437479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104437479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:40.828586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9772): Terminating (SIGTERM) 10:44:40.870518 run iperf3-srv_10.42.42.10(pid=9773): Terminating (SIGTERM) 10:44:40.912674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9774): Terminating (SIGTERM) 10:44:40.955058 run iperf3-srv_10.42.42.10(pid=9775): Terminating (SIGTERM) 10:44:40.997040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9776): Terminating (SIGTERM) 10:44:41.039500 run iperf3-srv_10.42.42.10(pid=9777): Terminating (SIGTERM) 10:44:41.081314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9778): Terminating (SIGTERM) 10:44:41.123741 run iperf3-srv_10.42.42.10(pid=9779): Terminating (SIGTERM) 10:44:41.165891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9782): Terminating (SIGTERM) 10:44:41.208382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9785): Terminating (SIGTERM) 10:44:41.250280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9788): Terminating (SIGTERM) 10:44:41.293116 --- ParallelTerminationStrategy: PID 9772 died... 10:44:41.313424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9772): Terminated: ok {rc=0} 10:44:41.359915 --- ParallelTerminationStrategy: PID 9773 died... 10:44:41.379583 run iperf3-srv_10.42.42.10(pid=9773): Terminated {rc=256} 10:44:41.425677 --- ParallelTerminationStrategy: PID 9774 died... 10:44:41.445348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9774): Terminated: ok {rc=0} 10:44:41.491500 --- ParallelTerminationStrategy: PID 9775 died... 10:44:41.511143 run iperf3-srv_10.42.42.10(pid=9775): Terminated {rc=256} 10:44:41.557268 --- ParallelTerminationStrategy: PID 9776 died... 10:44:41.576797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9776): Terminated: ok {rc=0} 10:44:41.623173 --- ParallelTerminationStrategy: PID 9777 died... 10:44:41.642915 run iperf3-srv_10.42.42.10(pid=9777): Terminated {rc=256} 10:44:41.689106 --- ParallelTerminationStrategy: PID 9778 died... 10:44:41.708846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9778): Terminated: ok {rc=0} 10:44:41.755170 --- ParallelTerminationStrategy: PID 9779 died... 10:44:41.774922 run iperf3-srv_10.42.42.10(pid=9779): Terminated {rc=256} 10:44:41.821097 --- ParallelTerminationStrategy: PID 9782 died... 10:44:41.840814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9782): Terminated: ok {rc=0} 10:44:41.887415 --- ParallelTerminationStrategy: PID 9785 died... 10:44:41.907151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9785): Terminated: ok {rc=0} 10:44:41.953395 --- ParallelTerminationStrategy: PID 9788 died... 10:44:41.973143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9788): Terminated: ok {rc=0} 10:44:42.061733 bus /gobi_4: Setting Powered False 10:44:43.161331 bus /gobi_4: Setting Powered False 10:44:44.278917 bus /gobi_1: Setting Powered False 10:44:45.374688 bus /gobi_1: Setting Powered False 10:44:46.491676 bus /gobi_0: Setting Powered False 10:44:47.594908 bus /gobi_0: Setting Powered False 10:44:48.713390 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:44:49.815207 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:49.826776 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:44:49.897471 tst ping.py: using LAC 40382 10:44:50.022408 tst ping.py: using RAC 92 10:44:50.148438 tst ping.py: using CellId 40382 10:44:50.273504 tst ping.py: using BVCI 40383 10:44:50.390674 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:50.402384 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:50.413768 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:50.424837 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:50.435910 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:50.447081 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:50.458438 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:50.469576 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:44:50.587672 tst ping.py:19: start network... 10:44:50.804215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:51.298645 run create_hlr_db(pid=9790): Launched 10:44:51.430491 bus /gobi_6: Setting Powered False 10:44:52.494532 run create_hlr_db(pid=9790): Terminated: ok {rc=0} 10:44:52.925130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9792): Launched 10:44:53.227676 run osmo-hlr_10.42.42.2(pid=9793): Launched 10:44:53.342392 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:53.866142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9795): Launched 10:44:54.165255 run osmo-stp_10.42.42.5(pid=9796): Launched 10:44:54.280114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:44:54.797728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9798): Launched 10:44:54.913768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:44:55.167587 run patchelf(pid=9799): Launched 10:44:55.336659 run osmo-stp_10.42.42.5(pid=9796): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9796)] 10:44:55.464275 run osmo-stp_10.42.42.5(pid=9796): stdout: | (launched: 2022-12-14_10:44:54.109335) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:55.593794 run osmo-stp_10.42.42.5(pid=9796): stderr: | 20221214104454276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104454276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104454276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104454276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104454277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104454277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104454277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:55.723112 run osmo-stp_10.42.42.5(pid=9796): stdout: | (launched: 2022-12-14_10:44:54.109335) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:55.845895 run osmo-stp_10.42.42.5(pid=9796): stderr: | 20221214104454276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104454276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104454276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104454276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104454277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104454277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104454277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:55.991325 run patchelf(pid=9799): Terminating (SIGINT) 10:44:56.160627 run patchelf(pid=9799): Terminated: ok {rc=0} 10:44:56.283207 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9796): Process ended prematurely: osmo-stp_10.42.42.5(pid=9796) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9796)] [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 10:44:56.292255 tst ping.py:22: Test FAILED (6.5 sec) 10:44:56.319381 run osmo-hlr_10.42.42.2(pid=9793): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9793)] 10:44:56.367906 run osmo-hlr_10.42.42.2(pid=9793): stdout: | (launched: 2022-12-14_10:44:53.171640) 10:44:56.418385 run osmo-hlr_10.42.42.2(pid=9793): stderr: | 20221214104453345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104453345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104453345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104453345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104453345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104453345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104453357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104453365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104453366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104453366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:56.469130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9792): Terminating (SIGTERM) 10:44:56.509319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9795): Terminating (SIGTERM) 10:44:56.549419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9798): Terminating (SIGTERM) 10:44:56.589903 --- ParallelTerminationStrategy: PID 9792 died... 10:44:56.609916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9792): Terminated: ok {rc=0} 10:44:56.654524 --- ParallelTerminationStrategy: PID 9795 died... 10:44:56.673649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9795): Terminated: ok {rc=0} 10:44:56.717998 --- ParallelTerminationStrategy: PID 9798 died... 10:44:56.737279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9798): Terminated: ok {rc=0} 10:44:56.822355 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:44:57.910010 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:57.922681 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:44:57.996940 tst ping_idle_ping.py: using LAC 40383 10:44:58.121860 tst ping_idle_ping.py: using RAC 93 10:44:58.239681 tst ping_idle_ping.py: using CellId 40383 10:44:58.357279 tst ping_idle_ping.py: using BVCI 40384 10:44:58.466579 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:58.477565 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:58.488402 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:58.499326 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:58.510773 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:58.522482 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:58.534182 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:44:58.545837 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:44:58.665249 tst ping_idle_ping.py:24: start network... 10:44:58.881320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:59.381304 run create_hlr_db(pid=9800): Launched 10:44:59.513536 bus /gobi_6: Setting Powered False 10:45:00.578017 run create_hlr_db(pid=9800): Terminated: ok {rc=0} 10:45:01.046662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9802): Launched 10:45:01.383046 run osmo-hlr_10.42.42.2(pid=9803): Launched 10:45:01.638048 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:02.294312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9808): Launched 10:45:02.625393 run osmo-stp_10.42.42.5(pid=9809): Launched 10:45:02.748266 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:03.301476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9811): Launched 10:45:03.424154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:03.695407 run patchelf(pid=9812): Launched 10:45:03.874931 run osmo-stp_10.42.42.5(pid=9809): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9809)] 10:45:04.010069 run osmo-stp_10.42.42.5(pid=9809): stdout: | (launched: 2022-12-14_10:45:02.565982) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:04.148543 run osmo-stp_10.42.42.5(pid=9809): stderr: | 20221214104502758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104502758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104502758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104502759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104502759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104502759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104502759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:04.286607 run osmo-stp_10.42.42.5(pid=9809): stdout: | (launched: 2022-12-14_10:45:02.565982) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:04.418527 run osmo-stp_10.42.42.5(pid=9809): stderr: | 20221214104502758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104502758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104502758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104502759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104502759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104502759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104502759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:04.573834 run patchelf(pid=9812): Terminating (SIGINT) 10:45:04.753634 run patchelf(pid=9812): Terminated: ok {rc=0} 10:45:04.884398 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9809): Process ended prematurely: osmo-stp_10.42.42.5(pid=9809) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9809)] [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:45:04.894068 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 10:45:04.923119 run osmo-hlr_10.42.42.2(pid=9803): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9803)] 10:45:04.974239 run osmo-hlr_10.42.42.2(pid=9803): stdout: | (launched: 2022-12-14_10:45:01.323853) 10:45:05.027268 run osmo-hlr_10.42.42.2(pid=9803): stderr: | 20221214104501524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104501524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104501524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104501524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104501524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104501524 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104501537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104501560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104501561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104501561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:05.080624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9802): Terminating (SIGTERM) 10:45:05.123018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9808): Terminating (SIGTERM) 10:45:05.166329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9811): Terminating (SIGTERM) 10:45:05.209374 --- ParallelTerminationStrategy: PID 9802 died... 10:45:05.229909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9802): Terminated: ok {rc=0} 10:45:05.277071 --- ParallelTerminationStrategy: PID 9808 died... 10:45:05.297016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9808): Terminated: ok {rc=0} 10:45:05.343735 --- ParallelTerminationStrategy: PID 9811 died... 10:45:05.363608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9811): Terminated: ok {rc=0} 10:45:05.453231 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:45:06.761049 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:45:06.768918 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:45:06.803950 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:45:06.839857 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:45:06.896909 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:45:06.930094 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:45:06.964600 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:45:07.521479 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:45:07.527693 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:45:07.539858 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:45:07.611920 tst switch_tch_pdch.py: using LAC 40384 10:45:07.738343 tst switch_tch_pdch.py: using RAC 94 10:45:07.867044 tst switch_tch_pdch.py: using CellId 40384 10:45:07.991564 tst switch_tch_pdch.py: using BVCI 40385 10:45:08.103286 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:45:08.114930 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:45:08.125849 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:45:08.136913 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:45:08.149144 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:45:08.161104 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:45:08.173176 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:45:08.185265 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:45:08.308384 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:45:08.434950 tst switch_tch_pdch.py:51: start network... 10:45:08.650081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:09.145067 run create_hlr_db(pid=9817): Launched 10:45:09.275795 bus /gobi_6: Setting Powered False 10:45:10.335272 run create_hlr_db(pid=9817): Terminated: ok {rc=0} 10:45:10.780492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9819): Launched 10:45:11.099844 run osmo-hlr_10.42.42.2(pid=9820): Launched 10:45:11.220669 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:11.773758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9822): Launched 10:45:12.093270 run osmo-stp_10.42.42.5(pid=9823): Launched 10:45:12.215325 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:12.762570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9825): Launched 10:45:12.885713 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:13.155384 run patchelf(pid=9826): Launched 10:45:13.332939 run osmo-stp_10.42.42.5(pid=9823): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9823)] 10:45:13.467391 run osmo-stp_10.42.42.5(pid=9823): stdout: | (launched: 2022-12-14_10:45:12.034360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:13.603972 run osmo-stp_10.42.42.5(pid=9823): stderr: | 20221214104512225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104512225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104512226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104512226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104512226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104512227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104512227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:13.739824 run osmo-stp_10.42.42.5(pid=9823): stdout: | (launched: 2022-12-14_10:45:12.034360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:13.869297 run osmo-stp_10.42.42.5(pid=9823): stderr: | 20221214104512225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104512225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104512226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104512226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104512226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104512227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104512227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:14.024293 run patchelf(pid=9826): Terminating (SIGINT) 10:45:14.203161 run patchelf(pid=9826): Terminated: ok {rc=0} 10:45:14.331756 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9823): Process ended prematurely: osmo-stp_10.42.42.5(pid=9823) [trial-2403↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9823)] [trial-2403↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:45:14.341947 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 10:45:14.370136 run osmo-hlr_10.42.42.2(pid=9820): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9820)] 10:45:14.420374 run osmo-hlr_10.42.42.2(pid=9820): stdout: | (launched: 2022-12-14_10:45:11.041527) 10:45:14.472403 run osmo-hlr_10.42.42.2(pid=9820): stderr: | 20221214104511237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104511237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104511237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104511237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104511237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104511237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104511249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104511257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104511258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104511258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:14.524493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9819): Terminating (SIGTERM) 10:45:14.566528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9822): Terminating (SIGTERM) 10:45:14.609238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9825): Terminating (SIGTERM) 10:45:14.651341 --- ParallelTerminationStrategy: PID 9819 died... 10:45:14.671542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9819): Terminated: ok {rc=0} 10:45:14.718008 --- ParallelTerminationStrategy: PID 9822 died... 10:45:14.737542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9822): Terminated: ok {rc=0} 10:45:14.783630 --- ParallelTerminationStrategy: PID 9825 died... 10:45:14.803268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9825): Terminated: ok {rc=0} 10:45:14.891052 bus /gobi_0: Setting Powered False 10:45:15.993268 bus /gobi_0: Setting Powered False 10:45:17.111248 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:45:18.362436 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:45:18.368655 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:45:18.401501 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:45:18.440722 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:45:18.494949 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:45:18.527840 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:45:18.562274 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:45:19.120167 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:45:19.125555 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:45:19.136777 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:45:19.206555 tst switch_tch_pdch.py: using LAC 40385 10:45:19.331365 tst switch_tch_pdch.py: using RAC 95 10:45:19.454832 tst switch_tch_pdch.py: using CellId 40385 10:45:19.580235 tst switch_tch_pdch.py: using BVCI 40386 10:45:19.697258 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:45:19.708639 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:45:19.719815 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:45:19.731053 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:45:19.742179 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:45:19.753407 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:45:19.764668 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:45:19.775878 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:45:19.896440 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:45:20.015037 tst switch_tch_pdch.py:51: start network... 10:45:20.216354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:20.654039 run create_hlr_db(pid=9830): Launched 10:45:20.771407 bus /gobi_6: Setting Powered False 10:45:21.831088 run create_hlr_db(pid=9830): Terminated: ok {rc=0} 10:45:22.242739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9832): Launched 10:45:22.562524 run osmo-hlr_10.42.42.2(pid=9833): Launched 10:45:22.684662 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:23.212189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9835): Launched 10:45:23.531112 run osmo-stp_10.42.42.5(pid=9836): Launched 10:45:23.654726 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:24.178132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9838): Launched 10:45:24.300483 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:24.570240 run patchelf(pid=9839): Launched 10:45:24.749243 run osmo-stp_10.42.42.5(pid=9836): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9836)] 10:45:24.883784 run osmo-stp_10.42.42.5(pid=9836): stdout: | (launched: 2022-12-14_10:45:23.472523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:25.020737 run osmo-stp_10.42.42.5(pid=9836): stderr: | 20221214104523660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104523660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104523660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104523661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104523661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104523661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104523661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:25.157913 run osmo-stp_10.42.42.5(pid=9836): stdout: | (launched: 2022-12-14_10:45:23.472523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:25.288078 run osmo-stp_10.42.42.5(pid=9836): stderr: | 20221214104523660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104523660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104523660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104523661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104523661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104523661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104523661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:25.442494 run patchelf(pid=9839): Terminating (SIGINT) 10:45:25.622371 run patchelf(pid=9839): Terminated: ok {rc=0} 10:45:25.752194 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9836): Process ended prematurely: osmo-stp_10.42.42.5(pid=9836) [trial-2403↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9836)] [trial-2403↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:45:25.761984 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 10:45:25.790088 run osmo-hlr_10.42.42.2(pid=9833): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9833)] 10:45:25.840552 run osmo-hlr_10.42.42.2(pid=9833): stdout: | (launched: 2022-12-14_10:45:22.503756) 10:45:25.892530 run osmo-hlr_10.42.42.2(pid=9833): stderr: | 20221214104522698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104522698 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104522698 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104522698 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104522698 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104522698 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104522711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104522719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104522720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104522720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:25.945031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9832): Terminating (SIGTERM) 10:45:25.987311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9835): Terminating (SIGTERM) 10:45:26.029944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9838): Terminating (SIGTERM) 10:45:26.072201 --- ParallelTerminationStrategy: PID 9832 died... 10:45:26.092537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9832): Terminated: ok {rc=0} 10:45:26.139085 --- ParallelTerminationStrategy: PID 9835 died... 10:45:26.159084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9835): Terminated: ok {rc=0} 10:45:26.205523 --- ParallelTerminationStrategy: PID 9838 died... 10:45:26.225398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9838): Terminated: ok {rc=0} 10:45:26.313717 bus /gobi_0: Setting Powered False 10:45:27.412774 bus /gobi_0: Setting Powered False 10:45:28.529341 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 10:45:29.780502 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:45:29.784610 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:45:29.813502 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 10:45:29.820120 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 10:45:29.875152 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:45:29.905056 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 10:45:29.911903 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 10:45:30.446409 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 10:45:30.451724 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 10:45:30.462735 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:45:30.506810 tst mo_mt_sms.py: using LAC 40386 10:45:30.631068 tst mo_mt_sms.py: using RAC 96 10:45:30.748554 tst mo_mt_sms.py: using CellId 40386 10:45:30.888679 tst mo_mt_sms.py: using BVCI 40387 10:45:31.013314 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:45:31.135812 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:45:31.278549 tst mo_mt_sms.py:9: start nitb and bts... 10:45:31.486129 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:45:32.106988 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9844): Launched 10:45:32.409333 run osmo-nitb_10.42.42.2(pid=9845): Launched 10:45:32.576091 run osmo-nitb_10.42.42.2(pid=9845): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9845)] 10:45:32.711048 run osmo-nitb_10.42.42.2(pid=9845): stdout: | (launched: 2022-12-14_10:45:32.353831) 10:45:32.847320 run osmo-nitb_10.42.42.2(pid=9845): stderr: | (launched: 2022-12-14_10:45:32.398309) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:45:32.983819 run osmo-nitb_10.42.42.2(pid=9845): stdout: | (launched: 2022-12-14_10:45:32.353831) 10:45:33.114674 run osmo-nitb_10.42.42.2(pid=9845): stderr: | (launched: 2022-12-14_10:45:32.398309) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9845): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9845) [trial-2403↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9845)] 10:45:33.522748 tst osmo-nitb_10.42.42.2(pid=9845): stdout: | (launched: 2022-12-14_10:45:32.353831) 10:45:33.643622 tst osmo-nitb_10.42.42.2(pid=9845): stderr: | (launched: 2022-12-14_10:45:32.398309) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:45:33.786478 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9845): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9845) [trial-2403↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9845)] [trial-2403↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 10:45:33.795060 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 10:45:33.801925 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9844): Terminating (SIGTERM) 10:45:34.014632 --- ParallelTerminationStrategy: PID 9844 died... 10:45:34.036549 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9844): Terminated: ok {rc=0} 10:45:34.127252 bus /sierra_3: Setting Powered False 10:45:35.227104 bus /sierra_3: Setting Powered False 10:45:36.345247 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 10:45:37.545647 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:45:37.550430 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:45:37.579284 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 10:45:37.607104 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 10:45:37.659224 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:45:37.689376 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 10:45:37.716865 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 10:45:38.265647 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 10:45:38.271079 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:45:38.282521 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:45:38.328662 tst mo_mt_sms.py: using LAC 40387 10:45:38.453735 tst mo_mt_sms.py: using RAC 97 10:45:38.575757 tst mo_mt_sms.py: using CellId 40387 10:45:38.692755 tst mo_mt_sms.py: using BVCI 40388 10:45:38.800339 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:45:38.811167 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:45:38.821827 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:45:38.832351 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:45:38.843323 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:45:38.854588 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:45:38.974831 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:45:39.090788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:39.554665 run create_hlr_db(pid=9849): Launched 10:45:39.670598 bus /sierra_2: Setting Powered False 10:45:40.730288 run create_hlr_db(pid=9849): Terminated: ok {rc=0} 10:45:41.169124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9851): Launched 10:45:41.488166 run osmo-hlr_10.42.42.2(pid=9852): Launched 10:45:41.610985 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:42.158370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9854): Launched 10:45:42.479912 run osmo-stp_10.42.42.5(pid=9855): Launched 10:45:42.602384 run osmo-msc_10.42.42.6: Starting osmo-msc 10:45:43.184817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9857): Launched 10:45:43.505077 run osmo-msc_10.42.42.6(pid=9858): Launched 10:45:43.676259 run osmo-stp_10.42.42.5(pid=9855): ERR: Terminated: ERROR {rc=1} [trial-2403↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9855)] 10:45:43.806247 run osmo-stp_10.42.42.5(pid=9855): stdout: | (launched: 2022-12-14_10:45:42.420731) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:43.933146 run osmo-stp_10.42.42.5(pid=9855): stderr: | 20221214104542612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104542613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104542613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104542613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104542614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104542614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104542614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:44.058501 run osmo-stp_10.42.42.5(pid=9855): stdout: | (launched: 2022-12-14_10:45:42.420731) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:44.177712 run osmo-stp_10.42.42.5(pid=9855): stderr: | 20221214104542612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104542613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104542613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104542613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104542614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104542614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104542614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:44.320400 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9855): Process ended prematurely: osmo-stp_10.42.42.5(pid=9855) [trial-2403↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9855)] [trial-2403↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 10:45:44.329024 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 10:45:44.355520 run osmo-hlr_10.42.42.2(pid=9852): ERR: Terminated: ERROR {rc=237} [trial-2403↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9852)] 10:45:44.404049 run osmo-hlr_10.42.42.2(pid=9852): stdout: | (launched: 2022-12-14_10:45:41.429378) 10:45:44.454053 run osmo-hlr_10.42.42.2(pid=9852): stderr: | 20221214104541625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104541625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104541625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104541625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104541625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104541625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104541637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104541645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104541646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104541646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:44.524043 run osmo-msc_10.42.42.6(pid=9858): ERR: Terminated: ERROR {rc=2} [trial-2403↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9858)] 10:45:44.571805 run osmo-msc_10.42.42.6(pid=9858): stdout: | (launched: 2022-12-14_10:45:43.446155) 10:45:44.621936 run osmo-msc_10.42.42.6(pid=9858): stderr: | 20221214104543718 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104543718 DLGLOBAL DEBUG validating counter group 0x7f3cf7592c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104543718 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104543718 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104543718 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104543719 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104543720 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104543721 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104543721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104543721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:45:44.672420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9851): Terminating (SIGTERM) 10:45:44.712867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9854): Terminating (SIGTERM) 10:45:44.753332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9857): Terminating (SIGTERM) 10:45:44.794180 --- ParallelTerminationStrategy: PID 9851 died... 10:45:44.814142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9851): Terminated: ok {rc=0} 10:45:44.859038 --- ParallelTerminationStrategy: PID 9854 died... 10:45:44.878202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9854): Terminated: ok {rc=0} 10:45:44.922829 --- ParallelTerminationStrategy: PID 9857 died... 10:45:44.942163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9857): Terminated: ok {rc=0} 10:45:45.027458 bus /sierra_3: Setting Powered False 10:45:46.124086 bus /sierra_3: Setting Powered False 10:45:47.247212 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 10:45:48.473920 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:45:48.478864 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:45:48.508720 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 10:45:48.516350 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 10:45:48.553575 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:45:48.583887 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 10:45:48.591014 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 10:45:49.110495 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2403 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 10:45:49.116164 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 10:45:49.127739 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:45:49.173724 tst assert_extension.py: using LAC 40388 10:45:49.299507 tst assert_extension.py: using RAC 98 10:45:49.424489 tst assert_extension.py: using CellId 40388 10:45:49.552877 tst assert_extension.py: using BVCI 40389 10:45:49.668474 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 10:45:49.786631 tst assert_extension.py:10: start nitb and bts... 10:45:49.986843 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:45:50.600051 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9863): Launched 10:45:50.899309 run osmo-nitb_10.42.42.2(pid=9864): Launched 10:45:51.066294 run osmo-nitb_10.42.42.2(pid=9864): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9864)] 10:45:51.201720 run osmo-nitb_10.42.42.2(pid=9864): stdout: | (launched: 2022-12-14_10:45:50.844068) 10:45:51.338156 run osmo-nitb_10.42.42.2(pid=9864): stderr: | (launched: 2022-12-14_10:45:50.888220) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:45:51.474875 run osmo-nitb_10.42.42.2(pid=9864): stdout: | (launched: 2022-12-14_10:45:50.844068) 10:45:51.605584 run osmo-nitb_10.42.42.2(pid=9864): stderr: | (launched: 2022-12-14_10:45:50.888220) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9864): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9864) [trial-2403↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9864)] 10:45:52.013294 tst osmo-nitb_10.42.42.2(pid=9864): stdout: | (launched: 2022-12-14_10:45:50.844068) 10:45:52.134947 tst osmo-nitb_10.42.42.2(pid=9864): stderr: | (launched: 2022-12-14_10:45:50.888220) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:45:52.276939 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9864): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9864) [trial-2403↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9864)] [trial-2403↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 10:45:52.285442 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:45:52.292130 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9863): Terminating (SIGTERM) 10:45:52.501642 --- ParallelTerminationStrategy: PID 9863 died... 10:45:52.523042 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9863): Terminated: ok {rc=0} 10:45:52.610827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 10:45:53.786373 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:45:53.790585 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:45:53.819453 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 10:45:53.847698 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 10:45:53.883887 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:45:53.913282 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 10:45:53.939943 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 10:45:54.468151 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2403 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 10:45:54.474709 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:45:54.486431 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:45:54.532554 tst assert_extension.py: using LAC 40389 10:45:54.658861 tst assert_extension.py: using RAC 99 10:45:54.783933 tst assert_extension.py: using CellId 40389 10:45:54.907782 tst assert_extension.py: using BVCI 40390 10:45:55.023127 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:45:55.034436 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:45:55.045655 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:45:55.056671 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:45:55.067817 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:45:55.078855 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 10:45:55.195189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:55.660173 run create_hlr_db(pid=9869): Launched 10:45:55.775064 bus /sierra_2: Setting Powered False 10:45:56.835236 run create_hlr_db(pid=9869): Terminated: ok {rc=0} 10:45:57.255435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9871): Launched 10:45:57.556815 run osmo-hlr_10.42.42.2(pid=9872): Launched 10:45:57.672164 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:58.194216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9874): Launched 10:45:58.494523 run osmo-stp_10.42.42.5(pid=9875): Launched 10:45:58.611295 run osmo-msc_10.42.42.6: Starting osmo-msc 10:45:59.151087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9877): Launched 10:45:59.452438 run osmo-msc_10.42.42.6(pid=9878): Launched 10:45:59.620099 run osmo-stp_10.42.42.5(pid=9875): ERR: Terminated: ERROR {rc=1} [trial-2403↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9875)] 10:45:59.747160 run osmo-stp_10.42.42.5(pid=9875): stdout: | (launched: 2022-12-14_10:45:58.438886) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:59.873562 run osmo-stp_10.42.42.5(pid=9875): stderr: | 20221214104558607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104558607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104558607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104558607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104558608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104558608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104558608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:59.998020 run osmo-stp_10.42.42.5(pid=9875): stdout: | (launched: 2022-12-14_10:45:58.438886) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:00.116928 run osmo-stp_10.42.42.5(pid=9875): stderr: | 20221214104558607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104558607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104558607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104558607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104558608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104558608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104558608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:00.258941 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9875): Process ended prematurely: osmo-stp_10.42.42.5(pid=9875) [trial-2403↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9875)] [trial-2403↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 10:46:00.267304 tst assert_extension.py:17: Test FAILED (5.8 sec) 10:46:00.293819 run osmo-hlr_10.42.42.2(pid=9872): ERR: Terminated: ERROR {rc=237} [trial-2403↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9872)] 10:46:00.342831 run osmo-hlr_10.42.42.2(pid=9872): stdout: | (launched: 2022-12-14_10:45:57.500763) 10:46:00.393122 run osmo-hlr_10.42.42.2(pid=9872): stderr: | 20221214104557674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104557674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104557674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104557674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104557674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104557674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104557690 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104557699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104557699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104557699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:00.463065 run osmo-msc_10.42.42.6(pid=9878): ERR: Terminated: ERROR {rc=2} [trial-2403↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9878)] 10:46:00.510872 run osmo-msc_10.42.42.6(pid=9878): stdout: | (launched: 2022-12-14_10:45:59.396919) 10:46:00.560825 run osmo-msc_10.42.42.6(pid=9878): stderr: | 20221214104559668 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104559668 DLGLOBAL DEBUG validating counter group 0x7fd7cff17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104559668 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104559668 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104559668 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104559668 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104559670 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104559670 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104559671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104559671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:46:00.611401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9871): Terminating (SIGTERM) 10:46:00.651601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9874): Terminating (SIGTERM) 10:46:00.692101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9877): Terminating (SIGTERM) 10:46:00.732701 --- ParallelTerminationStrategy: PID 9871 died... 10:46:00.752257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9871): Terminated: ok {rc=0} 10:46:00.797746 --- ParallelTerminationStrategy: PID 9874 died... 10:46:00.816985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9874): Terminated: ok {rc=0} 10:46:00.886282 --- ParallelTerminationStrategy: PID 9877 died... 10:46:00.912201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9877): Terminated: ok {rc=0} 10:46:01.006497 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:46:02.226515 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:46:02.234729 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:46:02.265645 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:46:02.295005 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:46:02.353340 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:46:02.382915 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:46:02.409414 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:46:02.963320 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:46:03.018409 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:46:03.030389 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:46:03.096635 tst mo_mt_call.py: using LAC 40390 10:46:03.222628 tst mo_mt_call.py: using RAC 100 10:46:03.349848 tst mo_mt_call.py: using CellId 40390 10:46:03.475878 tst mo_mt_call.py: using BVCI 40391 10:46:03.593727 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:46:03.605734 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:46:03.617296 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:46:03.628761 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:46:03.640469 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:46:03.652098 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:46:03.770450 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:46:03.887043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:04.359742 run create_hlr_db(pid=9883): Launched 10:46:04.476694 bus /sierra_2: Setting Powered False 10:46:05.538054 run create_hlr_db(pid=9883): Terminated: ok {rc=0} 10:46:05.984263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9885): Launched 10:46:06.312349 run osmo-hlr_10.42.42.2(pid=9886): Launched 10:46:06.437302 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:06.999884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9888): Launched 10:46:07.330785 run osmo-stp_10.42.42.5(pid=9889): Launched 10:46:07.457504 run osmo-msc_10.42.42.6: Starting osmo-msc 10:46:08.049752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9891): Launched 10:46:08.377646 run osmo-msc_10.42.42.6(pid=9892): Launched 10:46:08.560107 run osmo-stp_10.42.42.5(pid=9889): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9889)] 10:46:08.696698 run osmo-stp_10.42.42.5(pid=9889): stdout: | (launched: 2022-12-14_10:46:07.270625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:08.833710 run osmo-stp_10.42.42.5(pid=9889): stderr: | 20221214104607463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104607463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104607463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104607464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104607464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104607464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104607464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:08.969978 run osmo-stp_10.42.42.5(pid=9889): stdout: | (launched: 2022-12-14_10:46:07.270625) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:09.099207 run osmo-stp_10.42.42.5(pid=9889): stderr: | 20221214104607463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104607463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104607463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104607464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104607464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104607464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104607464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:09.254655 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9889): Process ended prematurely: osmo-stp_10.42.42.5(pid=9889) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9889)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:46:09.264393 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:46:09.292540 run osmo-hlr_10.42.42.2(pid=9886): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9886)] 10:46:09.343110 run osmo-hlr_10.42.42.2(pid=9886): stdout: | (launched: 2022-12-14_10:46:06.252668) 10:46:09.395776 run osmo-hlr_10.42.42.2(pid=9886): stderr: | 20221214104606448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104606448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104606448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104606448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104606448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104606448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104606460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104606469 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104606469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104606469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:09.468414 run osmo-msc_10.42.42.6(pid=9892): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9892)] 10:46:09.518328 run osmo-msc_10.42.42.6(pid=9892): stdout: | (launched: 2022-12-14_10:46:08.317760) 10:46:09.570585 run osmo-msc_10.42.42.6(pid=9892): stderr: | 20221214104608639 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104608639 DLGLOBAL DEBUG validating counter group 0x7f1ed9102c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104608639 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104608639 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104608640 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104608640 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104608641 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104608642 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104608642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104608642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:46:09.622751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9885): Terminating (SIGTERM) 10:46:09.664760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9888): Terminating (SIGTERM) 10:46:09.707342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9891): Terminating (SIGTERM) 10:46:09.750101 --- ParallelTerminationStrategy: PID 9885 died... 10:46:09.770626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9885): Terminated: ok {rc=0} 10:46:09.817261 --- ParallelTerminationStrategy: PID 9888 died... 10:46:09.836987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9888): Terminated: ok {rc=0} 10:46:09.883254 --- ParallelTerminationStrategy: PID 9891 died... 10:46:09.903056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9891): Terminated: ok {rc=0} 10:46:09.991331 bus /sierra_3: Setting Powered False 10:46:11.090035 bus /sierra_3: Setting Powered False 10:46:12.205665 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:46:13.355669 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:46:13.368261 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:46:13.437565 tst mo_mt_call_osmux.py: using LAC 40391 10:46:13.567364 tst mo_mt_call_osmux.py: using RAC 101 10:46:13.695696 tst mo_mt_call_osmux.py: using CellId 40391 10:46:13.822898 tst mo_mt_call_osmux.py: using BVCI 40392 10:46:13.940672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:46:13.952545 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:46:13.964090 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:46:13.975671 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:46:13.987468 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:46:13.998993 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:46:14.117505 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:46:14.238407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:14.742331 run create_hlr_db(pid=9894): Launched 10:46:14.875758 bus /sierra_2: Setting Powered False 10:46:15.954112 run create_hlr_db(pid=9894): Terminated: ok {rc=0} 10:46:16.417989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9896): Launched 10:46:16.835321 run osmo-hlr_10.42.42.2(pid=9897): Launched 10:46:17.037356 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:17.759258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9899): Launched 10:46:18.065679 run osmo-stp_10.42.42.5(pid=9900): Launched 10:46:18.182706 run osmo-msc_10.42.42.6: Starting osmo-msc 10:46:18.739304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9902): Launched 10:46:19.046397 run osmo-msc_10.42.42.6(pid=9903): Launched 10:46:19.220115 run osmo-stp_10.42.42.5(pid=9900): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9900)] 10:46:19.350156 run osmo-stp_10.42.42.5(pid=9900): stdout: | (launched: 2022-12-14_10:46:18.008934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:19.480050 run osmo-stp_10.42.42.5(pid=9900): stderr: | 20221214104618177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104618177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104618177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104618178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104618178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104618178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104618178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:19.607536 run osmo-stp_10.42.42.5(pid=9900): stdout: | (launched: 2022-12-14_10:46:18.008934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:19.728773 run osmo-stp_10.42.42.5(pid=9900): stderr: | 20221214104618177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104618177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104618177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104618178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104618178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104618178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104618178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:19.874487 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9900): Process ended prematurely: osmo-stp_10.42.42.5(pid=9900) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9900)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:46:19.883681 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:46:19.910702 run osmo-hlr_10.42.42.2(pid=9897): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9897)] 10:46:19.959744 run osmo-hlr_10.42.42.2(pid=9897): stdout: | (launched: 2022-12-14_10:46:16.776560) 10:46:20.010175 run osmo-hlr_10.42.42.2(pid=9897): stderr: | 20221214104617128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104617128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104617128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104617128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104617128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104617128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104617148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104617173 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104617173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104617173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:20.080428 run osmo-msc_10.42.42.6(pid=9903): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9903)] 10:46:20.128778 run osmo-msc_10.42.42.6(pid=9903): stdout: | (launched: 2022-12-14_10:46:18.989661) 10:46:20.179227 run osmo-msc_10.42.42.6(pid=9903): stderr: | 20221214104619258 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104619258 DLGLOBAL DEBUG validating counter group 0x7fe189508c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104619258 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104619258 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104619258 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104619259 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104619260 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104619261 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104619261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104619261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:46:20.230544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9896): Terminating (SIGTERM) 10:46:20.271223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9899): Terminating (SIGTERM) 10:46:20.311822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9902): Terminating (SIGTERM) 10:46:20.352875 --- ParallelTerminationStrategy: PID 9896 died... 10:46:20.373070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9896): Terminated: ok {rc=0} 10:46:20.418037 --- ParallelTerminationStrategy: PID 9899 died... 10:46:20.437311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9899): Terminated: ok {rc=0} 10:46:20.482316 --- ParallelTerminationStrategy: PID 9902 died... 10:46:20.501711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9902): Terminated: ok {rc=0} 10:46:20.588937 bus /sierra_3: Setting Powered False 10:46:21.689666 bus /sierra_3: Setting Powered False 10:46:22.803302 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:46:24.053677 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:46:24.060858 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:46:24.090841 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:46:24.118559 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:46:24.171397 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:46:24.201922 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:46:24.229833 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:46:24.781813 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:46:24.835219 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:46:24.847164 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:46:24.919657 tst mo_mt_call.py: using LAC 40392 10:46:25.047499 tst mo_mt_call.py: using RAC 102 10:46:25.173861 tst mo_mt_call.py: using CellId 40392 10:46:25.300654 tst mo_mt_call.py: using BVCI 40393 10:46:25.420155 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:46:25.431951 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:46:25.443573 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:46:25.455202 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:46:25.467149 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:46:25.479015 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:46:25.597753 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:46:25.714212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:26.188100 run create_hlr_db(pid=9908): Launched 10:46:26.305296 bus /sierra_2: Setting Powered False 10:46:27.366091 run create_hlr_db(pid=9908): Terminated: ok {rc=0} 10:46:27.793703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9910): Launched 10:46:28.099651 run osmo-hlr_10.42.42.2(pid=9911): Launched 10:46:28.216448 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:28.744207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9913): Launched 10:46:29.050631 run osmo-stp_10.42.42.5(pid=9914): Launched 10:46:29.168724 run osmo-msc_10.42.42.6: Starting osmo-msc 10:46:29.720758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9916): Launched 10:46:30.026796 run osmo-msc_10.42.42.6(pid=9917): Launched 10:46:30.198263 run osmo-stp_10.42.42.5(pid=9914): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9914)] 10:46:30.327541 run osmo-stp_10.42.42.5(pid=9914): stdout: | (launched: 2022-12-14_10:46:28.993885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:30.457254 run osmo-stp_10.42.42.5(pid=9914): stderr: | 20221214104629163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104629163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104629163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104629164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104629164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104629164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104629164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:30.584711 run osmo-stp_10.42.42.5(pid=9914): stdout: | (launched: 2022-12-14_10:46:28.993885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:30.706507 run osmo-stp_10.42.42.5(pid=9914): stderr: | 20221214104629163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104629163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104629163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104629164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104629164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104629164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104629164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:30.865103 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9914): Process ended prematurely: osmo-stp_10.42.42.5(pid=9914) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9914)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:46:30.877058 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:46:30.915738 run osmo-hlr_10.42.42.2(pid=9911): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9911)] 10:46:30.967468 run osmo-hlr_10.42.42.2(pid=9911): stdout: | (launched: 2022-12-14_10:46:28.043089) 10:46:31.021357 run osmo-hlr_10.42.42.2(pid=9911): stderr: | 20221214104628217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104628217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104628217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104628217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104628217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104628217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104628230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104628240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104628240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104628241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:31.096168 run osmo-msc_10.42.42.6(pid=9917): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9917)] 10:46:31.148569 run osmo-msc_10.42.42.6(pid=9917): stdout: | (launched: 2022-12-14_10:46:29.970285) 10:46:31.203217 run osmo-msc_10.42.42.6(pid=9917): stderr: | 20221214104630239 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104630239 DLGLOBAL DEBUG validating counter group 0x7f7ccc96ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104630239 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104630239 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104630239 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104630240 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104630241 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104630242 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104630242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104630242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:46:31.258025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9910): Terminating (SIGTERM) 10:46:31.301844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9913): Terminating (SIGTERM) 10:46:31.349293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9916): Terminating (SIGTERM) 10:46:31.394894 --- ParallelTerminationStrategy: PID 9910 died... 10:46:31.415619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9910): Terminated: ok {rc=0} 10:46:31.464639 --- ParallelTerminationStrategy: PID 9913 died... 10:46:31.486822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9913): Terminated: ok {rc=0} 10:46:31.535663 --- ParallelTerminationStrategy: PID 9916 died... 10:46:31.556630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9916): Terminated: ok {rc=0} 10:46:31.648112 bus /sierra_3: Setting Powered False 10:46:32.746193 bus /sierra_3: Setting Powered False 10:46:33.861555 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:46:35.010690 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:46:35.023393 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:46:35.091878 tst mo_mt_call_osmux.py: using LAC 40393 10:46:35.213335 tst mo_mt_call_osmux.py: using RAC 103 10:46:35.333098 tst mo_mt_call_osmux.py: using CellId 40393 10:46:35.454107 tst mo_mt_call_osmux.py: using BVCI 40394 10:46:35.573726 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:46:35.586055 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:46:35.597931 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:46:35.609722 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:46:35.621656 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:46:35.633612 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:46:35.751659 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:46:35.873293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:36.380177 run create_hlr_db(pid=9919): Launched 10:46:36.514077 bus /sierra_2: Setting Powered False 10:46:37.579726 run create_hlr_db(pid=9919): Terminated: ok {rc=0} 10:46:38.017728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9921): Launched 10:46:38.324524 run osmo-hlr_10.42.42.2(pid=9922): Launched 10:46:38.441404 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:38.979970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9924): Launched 10:46:39.288070 run osmo-stp_10.42.42.5(pid=9925): Launched 10:46:39.409882 run osmo-msc_10.42.42.6: Starting osmo-msc 10:46:39.963664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9927): Launched 10:46:40.271178 run osmo-msc_10.42.42.6(pid=9928): Launched 10:46:40.442843 run osmo-stp_10.42.42.5(pid=9925): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9925)] 10:46:40.572202 run osmo-stp_10.42.42.5(pid=9925): stdout: | (launched: 2022-12-14_10:46:39.231158) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:40.701954 run osmo-stp_10.42.42.5(pid=9925): stderr: | 20221214104639406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104639406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104639407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104639407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104639407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104639408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104639408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:40.829465 run osmo-stp_10.42.42.5(pid=9925): stdout: | (launched: 2022-12-14_10:46:39.231158) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:40.950623 run osmo-stp_10.42.42.5(pid=9925): stderr: | 20221214104639406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104639406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104639407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104639407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104639407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104639408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104639408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:41.096085 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9925): Process ended prematurely: osmo-stp_10.42.42.5(pid=9925) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9925)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:46:41.105410 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:46:41.132244 run osmo-hlr_10.42.42.2(pid=9922): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9922)] 10:46:41.180908 run osmo-hlr_10.42.42.2(pid=9922): stdout: | (launched: 2022-12-14_10:46:38.267856) 10:46:41.230994 run osmo-hlr_10.42.42.2(pid=9922): stderr: | 20221214104638439 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104638439 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104638439 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104638439 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104638439 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104638439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104638451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104638461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104638461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104638461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:41.301090 run osmo-msc_10.42.42.6(pid=9928): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9928)] 10:46:41.349095 run osmo-msc_10.42.42.6(pid=9928): stdout: | (launched: 2022-12-14_10:46:40.214425) 10:46:41.399014 run osmo-msc_10.42.42.6(pid=9928): stderr: | 20221214104640483 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104640483 DLGLOBAL DEBUG validating counter group 0x7f721c778c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104640483 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104640483 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104640483 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104640484 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104640486 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104640487 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104640487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104640487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:46:41.449230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9921): Terminating (SIGTERM) 10:46:41.489563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9924): Terminating (SIGTERM) 10:46:41.529504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9927): Terminating (SIGTERM) 10:46:41.569882 --- ParallelTerminationStrategy: PID 9921 died... 10:46:41.589597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9921): Terminated: ok {rc=0} 10:46:41.634290 --- ParallelTerminationStrategy: PID 9924 died... 10:46:41.653481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9924): Terminated: ok {rc=0} 10:46:41.697837 --- ParallelTerminationStrategy: PID 9927 died... 10:46:41.716782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9927): Terminated: ok {rc=0} 10:46:41.804306 bus /sierra_3: Setting Powered False 10:46:42.902939 bus /sierra_3: Setting Powered False 10:46:44.019358 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:46:45.263901 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:46:45.270594 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:46:45.299826 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:46:45.327815 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:46:45.380312 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:46:45.410288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:46:45.437750 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:46:46.001523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:46:46.074214 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:46:46.090803 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:46:46.178573 tst mo_mt_call.py: using LAC 40394 10:46:46.325202 tst mo_mt_call.py: using RAC 104 10:46:46.461280 tst mo_mt_call.py: using CellId 40394 10:46:46.589523 tst mo_mt_call.py: using BVCI 40395 10:46:46.709093 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:46:46.722016 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:46:46.734547 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:46:46.747027 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:46:46.760636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:46:46.774294 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:46:46.903613 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:46:47.025681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:47.569684 run create_hlr_db(pid=9933): Launched 10:46:47.705895 bus /sierra_2: Setting Powered False 10:46:48.770514 run create_hlr_db(pid=9933): Terminated: ok {rc=0} 10:46:49.208094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9935): Launched 10:46:49.515295 run osmo-hlr_10.42.42.2(pid=9936): Launched 10:46:49.633092 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:50.158595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9938): Launched 10:46:50.465161 run osmo-stp_10.42.42.5(pid=9939): Launched 10:46:50.581429 run osmo-msc_10.42.42.6: Starting osmo-msc 10:46:51.137606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9941): Launched 10:46:51.445302 run osmo-msc_10.42.42.6(pid=9942): Launched 10:46:51.617270 run osmo-stp_10.42.42.5(pid=9939): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9939)] 10:46:51.747290 run osmo-stp_10.42.42.5(pid=9939): stdout: | (launched: 2022-12-14_10:46:50.408413) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:51.876766 run osmo-stp_10.42.42.5(pid=9939): stderr: | 20221214104650579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104650579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104650580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104650580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104650581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104650581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104650581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:52.004445 run osmo-stp_10.42.42.5(pid=9939): stdout: | (launched: 2022-12-14_10:46:50.408413) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:52.125772 run osmo-stp_10.42.42.5(pid=9939): stderr: | 20221214104650579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104650579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104650580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104650580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104650581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104650581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104650581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:52.271282 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9939): Process ended prematurely: osmo-stp_10.42.42.5(pid=9939) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9939)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:46:52.280311 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:46:52.307120 run osmo-hlr_10.42.42.2(pid=9936): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9936)] 10:46:52.355822 run osmo-hlr_10.42.42.2(pid=9936): stdout: | (launched: 2022-12-14_10:46:49.458804) 10:46:52.406236 run osmo-hlr_10.42.42.2(pid=9936): stderr: | 20221214104649631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104649631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104649631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104649631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104649631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104649631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104649643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104649651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104649651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104649651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:52.476758 run osmo-msc_10.42.42.6(pid=9942): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9942)] 10:46:52.524483 run osmo-msc_10.42.42.6(pid=9942): stdout: | (launched: 2022-12-14_10:46:51.388514) 10:46:52.574519 run osmo-msc_10.42.42.6(pid=9942): stderr: | 20221214104651659 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104651659 DLGLOBAL DEBUG validating counter group 0x7f736ce90c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104651659 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104651659 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104651660 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104651660 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104651662 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104651662 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104651663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104651663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:46:52.624913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9935): Terminating (SIGTERM) 10:46:52.665204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9938): Terminating (SIGTERM) 10:46:52.705483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9941): Terminating (SIGTERM) 10:46:52.745961 --- ParallelTerminationStrategy: PID 9935 died... 10:46:52.765597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9935): Terminated: ok {rc=0} 10:46:52.809886 --- ParallelTerminationStrategy: PID 9938 died... 10:46:52.828709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9938): Terminated: ok {rc=0} 10:46:52.872906 --- ParallelTerminationStrategy: PID 9941 died... 10:46:52.892377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9941): Terminated: ok {rc=0} 10:46:52.979527 bus /sierra_3: Setting Powered False 10:46:54.080329 bus /sierra_3: Setting Powered False 10:46:55.196092 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:46:56.350755 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:46:56.363503 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:46:56.433183 tst mo_mt_call_osmux.py: using LAC 40395 10:46:56.560738 tst mo_mt_call_osmux.py: using RAC 105 10:46:56.692026 tst mo_mt_call_osmux.py: using CellId 40395 10:46:56.818804 tst mo_mt_call_osmux.py: using BVCI 40396 10:46:56.936625 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:46:56.948536 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:46:56.960263 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:46:56.971852 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:46:56.983765 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:46:56.995392 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:46:57.114337 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:46:57.233979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:57.738984 run create_hlr_db(pid=9944): Launched 10:46:57.873421 bus /sierra_2: Setting Powered False 10:46:58.938277 run create_hlr_db(pid=9944): Terminated: ok {rc=0} 10:46:59.374409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9946): Launched 10:46:59.681699 run osmo-hlr_10.42.42.2(pid=9947): Launched 10:46:59.798400 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:00.324452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9949): Launched 10:47:00.632015 run osmo-stp_10.42.42.5(pid=9950): Launched 10:47:00.749191 run osmo-msc_10.42.42.6: Starting osmo-msc 10:47:01.362025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9952): Launched 10:47:01.681750 run osmo-msc_10.42.42.6(pid=9953): Launched 10:47:02.067581 run osmo-stp_10.42.42.5(pid=9950): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9950)] 10:47:02.210059 run osmo-stp_10.42.42.5(pid=9950): stdout: | (launched: 2022-12-14_10:47:00.575331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:02.449209 run osmo-stp_10.42.42.5(pid=9950): stderr: | 20221214104700745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104700745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104700745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104700746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104700746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104700747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104700747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:02.577593 run osmo-stp_10.42.42.5(pid=9950): stdout: | (launched: 2022-12-14_10:47:00.575331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:02.698615 run osmo-stp_10.42.42.5(pid=9950): stderr: | 20221214104700745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104700745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104700745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104700746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104700746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104700747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104700747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:02.843891 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9950): Process ended prematurely: osmo-stp_10.42.42.5(pid=9950) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9950)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:47:02.852991 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:47:02.879737 run osmo-hlr_10.42.42.2(pid=9947): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9947)] 10:47:02.928154 run osmo-hlr_10.42.42.2(pid=9947): stdout: | (launched: 2022-12-14_10:46:59.624717) 10:47:02.978262 run osmo-hlr_10.42.42.2(pid=9947): stderr: | 20221214104659802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104659802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104659802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104659802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104659802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104659802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104659814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104659825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104659825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104659825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:03.048232 run osmo-msc_10.42.42.6(pid=9953): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9953)] 10:47:03.095971 run osmo-msc_10.42.42.6(pid=9953): stdout: | (launched: 2022-12-14_10:47:01.621545) 10:47:03.145773 run osmo-msc_10.42.42.6(pid=9953): stderr: | 20221214104702031 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104702031 DLGLOBAL DEBUG validating counter group 0x7fbf07bc0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104702031 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104702031 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104702031 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104702032 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104702033 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104702034 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104702034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104702034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:47:03.195950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9946): Terminating (SIGTERM) 10:47:03.236091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9949): Terminating (SIGTERM) 10:47:03.276106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9952): Terminating (SIGTERM) 10:47:03.316305 --- ParallelTerminationStrategy: PID 9946 died... 10:47:03.336138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9946): Terminated: ok {rc=0} 10:47:03.380527 --- ParallelTerminationStrategy: PID 9949 died... 10:47:03.399676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9949): Terminated: ok {rc=0} 10:47:03.443928 --- ParallelTerminationStrategy: PID 9952 died... 10:47:03.462959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9952): Terminated: ok {rc=0} 10:47:03.549322 bus /sierra_3: Setting Powered False 10:47:04.648794 bus /sierra_3: Setting Powered False 10:47:05.763416 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:47:07.012640 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:47:07.019962 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:47:07.049904 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:47:07.078002 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:47:07.130986 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:47:07.161150 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:47:07.188804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:47:07.741123 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:47:07.794611 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:47:07.806525 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:47:07.878734 tst mo_mt_call.py: using LAC 40396 10:47:08.007826 tst mo_mt_call.py: using RAC 106 10:47:08.133072 tst mo_mt_call.py: using CellId 40396 10:47:08.259080 tst mo_mt_call.py: using BVCI 40397 10:47:08.378600 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:47:08.390326 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:47:08.401959 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:47:08.413491 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:47:08.425288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:47:08.436781 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:47:08.555266 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:47:08.672876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:09.146138 run create_hlr_db(pid=9958): Launched 10:47:09.265831 bus /sierra_2: Setting Powered False 10:47:10.327492 run create_hlr_db(pid=9958): Terminated: ok {rc=0} 10:47:10.755875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9960): Launched 10:47:11.062918 run osmo-hlr_10.42.42.2(pid=9961): Launched 10:47:11.179172 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:11.719232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9963): Launched 10:47:12.025723 run osmo-stp_10.42.42.5(pid=9964): Launched 10:47:12.143211 run osmo-msc_10.42.42.6: Starting osmo-msc 10:47:12.696689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9966): Launched 10:47:13.005992 run osmo-msc_10.42.42.6(pid=9967): Launched 10:47:13.178753 run osmo-stp_10.42.42.5(pid=9964): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9964)] 10:47:13.308277 run osmo-stp_10.42.42.5(pid=9964): stdout: | (launched: 2022-12-14_10:47:11.968933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:13.437429 run osmo-stp_10.42.42.5(pid=9964): stderr: | 20221214104712137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104712137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104712138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104712138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104712138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104712139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104712139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:13.564774 run osmo-stp_10.42.42.5(pid=9964): stdout: | (launched: 2022-12-14_10:47:11.968933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:13.686095 run osmo-stp_10.42.42.5(pid=9964): stderr: | 20221214104712137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104712137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104712138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104712138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104712138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104712139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104712139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:13.831308 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9964): Process ended prematurely: osmo-stp_10.42.42.5(pid=9964) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9964)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:47:13.840412 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:47:13.867640 run osmo-hlr_10.42.42.2(pid=9961): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9961)] 10:47:13.916418 run osmo-hlr_10.42.42.2(pid=9961): stdout: | (launched: 2022-12-14_10:47:11.006402) 10:47:13.966175 run osmo-hlr_10.42.42.2(pid=9961): stderr: | 20221214104711182 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104711182 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104711182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104711182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104711182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104711182 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104711194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104711202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104711202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104711203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:14.036321 run osmo-msc_10.42.42.6(pid=9967): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9967)] 10:47:14.083822 run osmo-msc_10.42.42.6(pid=9967): stdout: | (launched: 2022-12-14_10:47:12.948927) 10:47:14.133756 run osmo-msc_10.42.42.6(pid=9967): stderr: | 20221214104713217 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104713217 DLGLOBAL DEBUG validating counter group 0x7fcaac008c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104713217 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104713217 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104713217 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104713217 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104713219 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104713219 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104713220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104713220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:47:14.183815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9960): Terminating (SIGTERM) 10:47:14.224023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9963): Terminating (SIGTERM) 10:47:14.264251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9966): Terminating (SIGTERM) 10:47:14.304617 --- ParallelTerminationStrategy: PID 9960 died... 10:47:14.324308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9960): Terminated: ok {rc=0} 10:47:14.369133 --- ParallelTerminationStrategy: PID 9963 died... 10:47:14.388276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9963): Terminated: ok {rc=0} 10:47:14.432366 --- ParallelTerminationStrategy: PID 9966 died... 10:47:14.451466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9966): Terminated: ok {rc=0} 10:47:14.536508 bus /sierra_3: Setting Powered False 10:47:15.633995 bus /sierra_3: Setting Powered False 10:47:16.759079 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:47:17.916040 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:47:17.928777 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:47:18.001020 tst mo_mt_call_osmux.py: using LAC 40397 10:47:18.128867 tst mo_mt_call_osmux.py: using RAC 107 10:47:18.256589 tst mo_mt_call_osmux.py: using CellId 40397 10:47:18.386423 tst mo_mt_call_osmux.py: using BVCI 40398 10:47:18.504175 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:47:18.516074 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:47:18.527645 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:47:18.539213 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:47:18.550921 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:47:18.562561 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:47:18.684497 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:47:18.803150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:19.276711 run create_hlr_db(pid=9969): Launched 10:47:19.394402 bus /sierra_2: Setting Powered False 10:47:20.455398 run create_hlr_db(pid=9969): Terminated: ok {rc=0} 10:47:20.902065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9971): Launched 10:47:21.229484 run osmo-hlr_10.42.42.2(pid=9972): Launched 10:47:21.355431 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:21.923593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9974): Launched 10:47:22.253473 run osmo-stp_10.42.42.5(pid=9975): Launched 10:47:22.378414 run osmo-msc_10.42.42.6: Starting osmo-msc 10:47:22.967895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9977): Launched 10:47:23.295862 run osmo-msc_10.42.42.6(pid=9978): Launched 10:47:23.477224 run osmo-stp_10.42.42.5(pid=9975): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9975)] 10:47:23.614046 run osmo-stp_10.42.42.5(pid=9975): stdout: | (launched: 2022-12-14_10:47:22.192832) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:23.752112 run osmo-stp_10.42.42.5(pid=9975): stderr: | 20221214104722385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104722385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104722385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104722386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104722386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104722386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104722386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:23.887766 run osmo-stp_10.42.42.5(pid=9975): stdout: | (launched: 2022-12-14_10:47:22.192832) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:24.016900 run osmo-stp_10.42.42.5(pid=9975): stderr: | 20221214104722385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104722385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104722385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104722386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104722386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104722386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104722386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:24.171661 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9975): Process ended prematurely: osmo-stp_10.42.42.5(pid=9975) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9975)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:47:24.181740 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:47:24.209841 run osmo-hlr_10.42.42.2(pid=9972): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9972)] 10:47:24.260663 run osmo-hlr_10.42.42.2(pid=9972): stdout: | (launched: 2022-12-14_10:47:21.169290) 10:47:24.313085 run osmo-hlr_10.42.42.2(pid=9972): stderr: | 20221214104721366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104721366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104721366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104721366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104721366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104721366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104721378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104721387 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104721388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104721388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:24.386004 run osmo-msc_10.42.42.6(pid=9978): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9978)] 10:47:24.436334 run osmo-msc_10.42.42.6(pid=9978): stdout: | (launched: 2022-12-14_10:47:23.235699) 10:47:24.488421 run osmo-msc_10.42.42.6(pid=9978): stderr: | 20221214104723557 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104723557 DLGLOBAL DEBUG validating counter group 0x7fb8a46f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104723557 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104723557 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104723557 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104723557 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104723559 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104723560 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104723560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104723560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:47:24.540940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9971): Terminating (SIGTERM) 10:47:24.582789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9974): Terminating (SIGTERM) 10:47:24.624740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9977): Terminating (SIGTERM) 10:47:24.667237 --- ParallelTerminationStrategy: PID 9971 died... 10:47:24.687927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9971): Terminated: ok {rc=0} 10:47:24.734542 --- ParallelTerminationStrategy: PID 9974 died... 10:47:24.754514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9974): Terminated: ok {rc=0} 10:47:24.800800 --- ParallelTerminationStrategy: PID 9977 died... 10:47:24.821296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9977): Terminated: ok {rc=0} 10:47:24.909387 bus /sierra_3: Setting Powered False 10:47:26.008057 bus /sierra_3: Setting Powered False 10:47:27.123827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:47:28.374927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:47:28.383096 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:47:28.413064 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:47:28.440386 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:47:28.492199 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:47:28.522217 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:47:28.549349 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:47:29.108680 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:47:29.160811 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:47:29.172495 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:47:29.238367 tst mo_mt_call.py: using LAC 40398 10:47:29.362820 tst mo_mt_call.py: using RAC 108 10:47:29.482607 tst mo_mt_call.py: using CellId 40398 10:47:29.602653 tst mo_mt_call.py: using BVCI 40399 10:47:29.714648 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:47:29.725914 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:47:29.737156 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:47:29.748195 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:47:29.759622 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:47:29.771136 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:47:29.892547 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:47:30.010490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:30.486948 run create_hlr_db(pid=9983): Launched 10:47:30.604561 bus /sierra_2: Setting Powered False 10:47:31.668803 run create_hlr_db(pid=9983): Terminated: ok {rc=0} 10:47:32.111786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9985): Launched 10:47:32.434944 run osmo-hlr_10.42.42.2(pid=9986): Launched 10:47:32.553566 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:33.092064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9988): Launched 10:47:33.399659 run osmo-stp_10.42.42.5(pid=9989): Launched 10:47:33.518293 run osmo-msc_10.42.42.6: Starting osmo-msc 10:47:34.071264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9991): Launched 10:47:34.379771 run osmo-msc_10.42.42.6(pid=9992): Launched 10:47:34.551863 run osmo-stp_10.42.42.5(pid=9989): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9989)] 10:47:34.682042 run osmo-stp_10.42.42.5(pid=9989): stdout: | (launched: 2022-12-14_10:47:33.342969) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:34.811856 run osmo-stp_10.42.42.5(pid=9989): stderr: | 20221214104733509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104733509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104733509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104733510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104733510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104733510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104733510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:34.939707 run osmo-stp_10.42.42.5(pid=9989): stdout: | (launched: 2022-12-14_10:47:33.342969) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:35.061543 run osmo-stp_10.42.42.5(pid=9989): stderr: | 20221214104733509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104733509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104733509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104733510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104733510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104733510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104733510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:35.207651 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9989): Process ended prematurely: osmo-stp_10.42.42.5(pid=9989) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9989)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:47:35.216891 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:47:35.243727 run osmo-hlr_10.42.42.2(pid=9986): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9986)] 10:47:35.292033 run osmo-hlr_10.42.42.2(pid=9986): stdout: | (launched: 2022-12-14_10:47:32.378104) 10:47:35.341827 run osmo-hlr_10.42.42.2(pid=9986): stderr: | 20221214104732551 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104732551 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104732551 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104732551 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104732551 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104732551 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104732567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104732576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104732576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104732576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:35.411660 run osmo-msc_10.42.42.6(pid=9992): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9992)] 10:47:35.459757 run osmo-msc_10.42.42.6(pid=9992): stdout: | (launched: 2022-12-14_10:47:34.323068) 10:47:35.509504 run osmo-msc_10.42.42.6(pid=9992): stderr: | 20221214104734592 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104734593 DLGLOBAL DEBUG validating counter group 0x7fba77900c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104734593 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104734593 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104734593 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104734593 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104734595 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104734596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104734596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104734596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:47:35.559608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9985): Terminating (SIGTERM) 10:47:35.600004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9988): Terminating (SIGTERM) 10:47:35.640293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9991): Terminating (SIGTERM) 10:47:35.680889 --- ParallelTerminationStrategy: PID 9985 died... 10:47:35.700688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9985): Terminated: ok {rc=0} 10:47:35.745131 --- ParallelTerminationStrategy: PID 9988 died... 10:47:35.764263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9988): Terminated: ok {rc=0} 10:47:35.808609 --- ParallelTerminationStrategy: PID 9991 died... 10:47:35.827732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9991): Terminated: ok {rc=0} 10:47:35.915232 bus /sierra_3: Setting Powered False 10:47:37.015481 bus /sierra_3: Setting Powered False 10:47:38.139587 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:47:39.290037 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:47:39.302586 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:47:39.371484 tst mo_mt_call_osmux.py: using LAC 40399 10:47:39.505384 tst mo_mt_call_osmux.py: using RAC 109 10:47:39.629509 tst mo_mt_call_osmux.py: using CellId 40399 10:47:39.749586 tst mo_mt_call_osmux.py: using BVCI 40400 10:47:39.862466 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:47:39.873966 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:47:39.885423 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:47:39.896576 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:47:39.908401 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:47:39.919929 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:47:40.038376 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:47:40.159371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:40.666480 run create_hlr_db(pid=9994): Launched 10:47:40.801710 bus /sierra_2: Setting Powered False 10:47:41.866316 run create_hlr_db(pid=9994): Terminated: ok {rc=0} 10:47:42.322708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9996): Launched 10:47:42.651539 run osmo-hlr_10.42.42.2(pid=9997): Launched 10:47:42.776421 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:43.342306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9999): Launched 10:47:43.670805 run osmo-stp_10.42.42.5(pid=10000): Launched 10:47:43.794987 run osmo-msc_10.42.42.6: Starting osmo-msc 10:47:44.385541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10002): Launched 10:47:44.714764 run osmo-msc_10.42.42.6(pid=10003): Launched 10:47:44.898164 run osmo-stp_10.42.42.5(pid=10000): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10000)] 10:47:45.034542 run osmo-stp_10.42.42.5(pid=10000): stdout: | (launched: 2022-12-14_10:47:43.610913) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:45.171757 run osmo-stp_10.42.42.5(pid=10000): stderr: | 20221214104743801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104743802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104743802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104743802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104743803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104743803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104743803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:45.308571 run osmo-stp_10.42.42.5(pid=10000): stdout: | (launched: 2022-12-14_10:47:43.610913) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:45.438066 run osmo-stp_10.42.42.5(pid=10000): stderr: | 20221214104743801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104743802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104743802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104743802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104743803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104743803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104743803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:45.593170 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10000): Process ended prematurely: osmo-stp_10.42.42.5(pid=10000) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10000)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:47:45.602885 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:47:45.631121 run osmo-hlr_10.42.42.2(pid=9997): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9997)] 10:47:45.681542 run osmo-hlr_10.42.42.2(pid=9997): stdout: | (launched: 2022-12-14_10:47:42.591556) 10:47:45.733589 run osmo-hlr_10.42.42.2(pid=9997): stderr: | 20221214104742788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104742788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104742788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104742789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104742789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104742789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104742802 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104742810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104742810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104742810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:45.806295 run osmo-msc_10.42.42.6(pid=10003): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10003)] 10:47:45.875145 run osmo-msc_10.42.42.6(pid=10003): stdout: | (launched: 2022-12-14_10:47:44.654350) 10:47:45.929542 run osmo-msc_10.42.42.6(pid=10003): stderr: | 20221214104744973 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104744973 DLGLOBAL DEBUG validating counter group 0x7ff00e9d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104744973 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104744973 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104744973 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104744974 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104744975 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104744976 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104744976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104744976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:47:45.982475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9996): Terminating (SIGTERM) 10:47:46.024511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9999): Terminating (SIGTERM) 10:47:46.069523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10002): Terminating (SIGTERM) 10:47:46.115875 --- ParallelTerminationStrategy: PID 9996 died... 10:47:46.137472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9996): Terminated: ok {rc=0} 10:47:46.185436 --- ParallelTerminationStrategy: PID 9999 died... 10:47:46.206259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9999): Terminated: ok {rc=0} 10:47:46.252995 --- ParallelTerminationStrategy: PID 10002 died... 10:47:46.274268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10002): Terminated: ok {rc=0} 10:47:46.364896 bus /sierra_3: Setting Powered False 10:47:47.462042 bus /sierra_3: Setting Powered False 10:47:48.577517 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:47:49.821864 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:47:49.828453 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:47:49.857421 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:47:49.885200 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:47:49.938895 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:47:49.969089 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:47:49.996505 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:47:50.545252 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:47:50.595908 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:47:50.607583 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:47:50.677995 tst mo_mt_call.py: using LAC 40400 10:47:50.798732 tst mo_mt_call.py: using RAC 110 10:47:50.918547 tst mo_mt_call.py: using CellId 40400 10:47:51.038749 tst mo_mt_call.py: using BVCI 40401 10:47:51.159201 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:47:51.171129 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:47:51.182794 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:47:51.194403 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:47:51.206179 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:47:51.217936 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:47:51.335362 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:47:51.452511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:51.927011 run create_hlr_db(pid=10008): Launched 10:47:52.044894 bus /sierra_2: Setting Powered False 10:47:53.106544 run create_hlr_db(pid=10008): Terminated: ok {rc=0} 10:47:53.554938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10010): Launched 10:47:53.883751 run osmo-hlr_10.42.42.2(pid=10011): Launched 10:47:54.009700 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:54.578024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10013): Launched 10:47:54.904671 run osmo-stp_10.42.42.5(pid=10014): Launched 10:47:55.030652 run osmo-msc_10.42.42.6: Starting osmo-msc 10:47:55.622071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10016): Launched 10:47:55.949493 run osmo-msc_10.42.42.6(pid=10017): Launched 10:47:56.132706 run osmo-stp_10.42.42.5(pid=10014): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10014)] 10:47:56.271051 run osmo-stp_10.42.42.5(pid=10014): stdout: | (launched: 2022-12-14_10:47:54.844531) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:56.409068 run osmo-stp_10.42.42.5(pid=10014): stderr: | 20221214104755035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104755035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104755036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104755036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104755036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104755037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104755037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:56.545153 run osmo-stp_10.42.42.5(pid=10014): stdout: | (launched: 2022-12-14_10:47:54.844531) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:56.674754 run osmo-stp_10.42.42.5(pid=10014): stderr: | 20221214104755035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104755035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104755036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104755036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104755036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104755037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104755037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:56.829752 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10014): Process ended prematurely: osmo-stp_10.42.42.5(pid=10014) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10014)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:47:56.839426 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:47:56.867372 run osmo-hlr_10.42.42.2(pid=10011): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10011)] 10:47:56.917428 run osmo-hlr_10.42.42.2(pid=10011): stdout: | (launched: 2022-12-14_10:47:53.823771) 10:47:56.969322 run osmo-hlr_10.42.42.2(pid=10011): stderr: | 20221214104754020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104754020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104754020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104754020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104754020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104754021 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104754033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104754042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104754042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104754042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:57.041669 run osmo-msc_10.42.42.6(pid=10017): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10017)] 10:47:57.091726 run osmo-msc_10.42.42.6(pid=10017): stdout: | (launched: 2022-12-14_10:47:55.888869) 10:47:57.143333 run osmo-msc_10.42.42.6(pid=10017): stderr: | 20221214104756210 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104756210 DLGLOBAL DEBUG validating counter group 0x7f2ad3e7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104756210 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104756210 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104756210 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104756210 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104756212 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104756212 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104756212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104756213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:47:57.195295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10010): Terminating (SIGTERM) 10:47:57.237474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10013): Terminating (SIGTERM) 10:47:57.279226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10016): Terminating (SIGTERM) 10:47:57.321597 --- ParallelTerminationStrategy: PID 10010 died... 10:47:57.341437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10010): Terminated: ok {rc=0} 10:47:57.388086 --- ParallelTerminationStrategy: PID 10013 died... 10:47:57.407918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10013): Terminated: ok {rc=0} 10:47:57.454678 --- ParallelTerminationStrategy: PID 10016 died... 10:47:57.474470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10016): Terminated: ok {rc=0} 10:47:57.562991 bus /sierra_3: Setting Powered False 10:47:58.663237 bus /sierra_3: Setting Powered False 10:47:59.778774 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:48:00.961838 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:48:00.975008 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:48:01.046166 tst mo_mt_call_osmux.py: using LAC 40401 10:48:01.171758 tst mo_mt_call_osmux.py: using RAC 111 10:48:01.302453 tst mo_mt_call_osmux.py: using CellId 40401 10:48:01.465403 tst mo_mt_call_osmux.py: using BVCI 40402 10:48:01.607049 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:48:01.619326 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:48:01.631281 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:48:01.643767 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:48:01.656617 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:48:01.669813 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:48:01.807540 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:48:01.932920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:02.453399 run create_hlr_db(pid=10019): Launched 10:48:02.589389 bus /sierra_2: Setting Powered False 10:48:03.654784 run create_hlr_db(pid=10019): Terminated: ok {rc=0} 10:48:04.093995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10021): Launched 10:48:04.402993 run osmo-hlr_10.42.42.2(pid=10022): Launched 10:48:04.520301 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:05.062885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10024): Launched 10:48:05.372551 run osmo-stp_10.42.42.5(pid=10025): Launched 10:48:05.489920 run osmo-msc_10.42.42.6: Starting osmo-msc 10:48:06.044520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10027): Launched 10:48:06.354278 run osmo-msc_10.42.42.6(pid=10028): Launched 10:48:06.527575 run osmo-stp_10.42.42.5(pid=10025): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10025)] 10:48:06.658043 run osmo-stp_10.42.42.5(pid=10025): stdout: | (launched: 2022-12-14_10:48:05.315661) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:06.787827 run osmo-stp_10.42.42.5(pid=10025): stderr: | 20221214104805483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104805483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104805483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104805484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104805484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104805484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104805484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:06.915868 run osmo-stp_10.42.42.5(pid=10025): stdout: | (launched: 2022-12-14_10:48:05.315661) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:07.037790 run osmo-stp_10.42.42.5(pid=10025): stderr: | 20221214104805483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104805483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104805483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104805484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104805484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104805484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104805484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:07.183688 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10025): Process ended prematurely: osmo-stp_10.42.42.5(pid=10025) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10025)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:48:07.192888 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:48:07.220114 run osmo-hlr_10.42.42.2(pid=10022): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10022)] 10:48:07.269351 run osmo-hlr_10.42.42.2(pid=10022): stdout: | (launched: 2022-12-14_10:48:04.346122) 10:48:07.319908 run osmo-hlr_10.42.42.2(pid=10022): stderr: | 20221214104804518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104804518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104804518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104804518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104804518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104804518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104804531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104804539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104804539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104804539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:07.391417 run osmo-msc_10.42.42.6(pid=10028): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10028)] 10:48:07.439673 run osmo-msc_10.42.42.6(pid=10028): stdout: | (launched: 2022-12-14_10:48:06.297210) 10:48:07.490017 run osmo-msc_10.42.42.6(pid=10028): stderr: | 20221214104806566 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104806566 DLGLOBAL DEBUG validating counter group 0x7ff142594c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104806567 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104806567 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104806567 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104806567 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104806569 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104806569 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104806569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104806569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:48:07.540845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10021): Terminating (SIGTERM) 10:48:07.581744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10024): Terminating (SIGTERM) 10:48:07.622499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10027): Terminating (SIGTERM) 10:48:07.663651 --- ParallelTerminationStrategy: PID 10021 died... 10:48:07.683463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10021): Terminated: ok {rc=0} 10:48:07.728428 --- ParallelTerminationStrategy: PID 10024 died... 10:48:07.747841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10024): Terminated: ok {rc=0} 10:48:07.793101 --- ParallelTerminationStrategy: PID 10027 died... 10:48:07.812496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10027): Terminated: ok {rc=0} 10:48:07.900746 bus /sierra_3: Setting Powered False 10:48:09.001138 bus /sierra_3: Setting Powered False 10:48:10.117475 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:48:11.372030 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:48:11.379353 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:48:11.409134 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:48:11.436813 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:48:11.490066 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:48:11.520258 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:48:11.547370 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:48:12.095248 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:48:12.144729 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:48:12.156017 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:48:12.222283 tst mo_mt_call.py: using LAC 40402 10:48:12.343516 tst mo_mt_call.py: using RAC 112 10:48:12.464896 tst mo_mt_call.py: using CellId 40402 10:48:12.585411 tst mo_mt_call.py: using BVCI 40403 10:48:12.696843 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:48:12.707991 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:48:12.718967 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:48:12.729975 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:48:12.741211 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:48:12.752350 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:48:12.868104 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:48:12.989960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:13.465722 run create_hlr_db(pid=10033): Launched 10:48:13.583388 bus /sierra_2: Setting Powered False 10:48:14.644454 run create_hlr_db(pid=10033): Terminated: ok {rc=0} 10:48:15.072923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10035): Launched 10:48:15.380155 run osmo-hlr_10.42.42.2(pid=10036): Launched 10:48:15.498495 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:16.065021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10038): Launched 10:48:16.412336 run osmo-stp_10.42.42.5(pid=10039): Launched 10:48:16.689572 run osmo-msc_10.42.42.6: Starting osmo-msc 10:48:17.300161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10041): Launched 10:48:17.609769 run osmo-msc_10.42.42.6(pid=10042): Launched 10:48:17.782715 run osmo-stp_10.42.42.5(pid=10039): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10039)] 10:48:17.913923 run osmo-stp_10.42.42.5(pid=10039): stdout: | (launched: 2022-12-14_10:48:16.350752) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:18.044469 run osmo-stp_10.42.42.5(pid=10039): stderr: | 20221214104816562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104816562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104816562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104816563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104816563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104816563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104816563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:18.173388 run osmo-stp_10.42.42.5(pid=10039): stdout: | (launched: 2022-12-14_10:48:16.350752) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:18.295794 run osmo-stp_10.42.42.5(pid=10039): stderr: | 20221214104816562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104816562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104816562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104816563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104816563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104816563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104816563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:18.442940 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10039): Process ended prematurely: osmo-stp_10.42.42.5(pid=10039) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10039)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:48:18.451981 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:48:18.478786 run osmo-hlr_10.42.42.2(pid=10036): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10036)] 10:48:18.527480 run osmo-hlr_10.42.42.2(pid=10036): stdout: | (launched: 2022-12-14_10:48:15.323372) 10:48:18.578173 run osmo-hlr_10.42.42.2(pid=10036): stderr: | 20221214104815495 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104815495 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104815495 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104815495 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104815495 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104815495 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104815507 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104815515 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104815515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104815516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:18.648859 run osmo-msc_10.42.42.6(pid=10042): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10042)] 10:48:18.697162 run osmo-msc_10.42.42.6(pid=10042): stdout: | (launched: 2022-12-14_10:48:17.552570) 10:48:18.748105 run osmo-msc_10.42.42.6(pid=10042): stderr: | 20221214104817822 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104817822 DLGLOBAL DEBUG validating counter group 0x7fb46d110c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104817822 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104817823 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104817823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104817823 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104817825 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104817825 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104817825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104817825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:48:18.798931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10035): Terminating (SIGTERM) 10:48:18.839592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10038): Terminating (SIGTERM) 10:48:18.880191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10041): Terminating (SIGTERM) 10:48:18.921780 --- ParallelTerminationStrategy: PID 10035 died... 10:48:18.942241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10035): Terminated: ok {rc=0} 10:48:18.987000 --- ParallelTerminationStrategy: PID 10038 died... 10:48:19.006307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10038): Terminated: ok {rc=0} 10:48:19.050636 --- ParallelTerminationStrategy: PID 10041 died... 10:48:19.069795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10041): Terminated: ok {rc=0} 10:48:19.156428 bus /sierra_3: Setting Powered False 10:48:20.256174 bus /sierra_3: Setting Powered False 10:48:21.372583 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:48:22.520095 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:48:22.532105 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:48:22.599445 tst mo_mt_call_osmux.py: using LAC 40403 10:48:22.721058 tst mo_mt_call_osmux.py: using RAC 113 10:48:22.840646 tst mo_mt_call_osmux.py: using CellId 40403 10:48:22.960015 tst mo_mt_call_osmux.py: using BVCI 40404 10:48:23.070905 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:48:23.082374 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:48:23.093310 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:48:23.104111 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:48:23.115498 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:48:23.126710 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:48:23.247374 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:48:23.370440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:23.877161 run create_hlr_db(pid=10044): Launched 10:48:24.010722 bus /sierra_2: Setting Powered False 10:48:25.075212 run create_hlr_db(pid=10044): Terminated: ok {rc=0} 10:48:25.513870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10046): Launched 10:48:25.822215 run osmo-hlr_10.42.42.2(pid=10047): Launched 10:48:25.938659 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:26.477551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10049): Launched 10:48:26.785115 run osmo-stp_10.42.42.5(pid=10050): Launched 10:48:26.902153 run osmo-msc_10.42.42.6: Starting osmo-msc 10:48:27.454311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10052): Launched 10:48:27.762936 run osmo-msc_10.42.42.6(pid=10053): Launched 10:48:27.934750 run osmo-stp_10.42.42.5(pid=10050): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10050)] 10:48:28.064800 run osmo-stp_10.42.42.5(pid=10050): stdout: | (launched: 2022-12-14_10:48:26.728334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:28.195068 run osmo-stp_10.42.42.5(pid=10050): stderr: | 20221214104826896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104826896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104826896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104826897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104826897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104826897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104826897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:28.323107 run osmo-stp_10.42.42.5(pid=10050): stdout: | (launched: 2022-12-14_10:48:26.728334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:28.444838 run osmo-stp_10.42.42.5(pid=10050): stderr: | 20221214104826896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104826896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104826896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104826897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104826897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104826897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104826897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:28.591417 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10050): Process ended prematurely: osmo-stp_10.42.42.5(pid=10050) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10050)] [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:48:28.600559 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:48:28.627481 run osmo-hlr_10.42.42.2(pid=10047): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10047)] 10:48:28.676013 run osmo-hlr_10.42.42.2(pid=10047): stdout: | (launched: 2022-12-14_10:48:25.765442) 10:48:28.725688 run osmo-hlr_10.42.42.2(pid=10047): stderr: | 20221214104825938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104825938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104825938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104825938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104825938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104825938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104825951 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104825959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104825959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104825959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:28.795790 run osmo-msc_10.42.42.6(pid=10053): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10053)] 10:48:28.843561 run osmo-msc_10.42.42.6(pid=10053): stdout: | (launched: 2022-12-14_10:48:27.705875) 10:48:28.893451 run osmo-msc_10.42.42.6(pid=10053): stderr: | 20221214104827974 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104827974 DLGLOBAL DEBUG validating counter group 0x7fef25d28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104827974 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104827974 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104827975 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104827975 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104827976 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104827977 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104827977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104827977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:48:28.943832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10046): Terminating (SIGTERM) 10:48:28.983695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10049): Terminating (SIGTERM) 10:48:29.024066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10052): Terminating (SIGTERM) 10:48:29.064523 --- ParallelTerminationStrategy: PID 10046 died... 10:48:29.084370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10046): Terminated: ok {rc=0} 10:48:29.128656 --- ParallelTerminationStrategy: PID 10049 died... 10:48:29.148037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10049): Terminated: ok {rc=0} 10:48:29.192308 --- ParallelTerminationStrategy: PID 10052 died... 10:48:29.211512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10052): Terminated: ok {rc=0} 10:48:29.295688 bus /sierra_3: Setting Powered False 10:48:30.392401 bus /sierra_3: Setting Powered False 10:48:31.517666 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 10:48:32.763791 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:48:32.768160 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:48:32.796749 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 10:48:32.823846 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 10:48:32.908586 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:48:32.937708 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 10:48:32.964353 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 10:48:33.552199 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2403 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 10:48:33.557939 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:48:33.569754 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:48:33.618330 tst emergency_mo_mt_call.py: using LAC 40404 10:48:33.745447 tst emergency_mo_mt_call.py: using RAC 114 10:48:33.870483 tst emergency_mo_mt_call.py: using CellId 40404 10:48:33.997417 tst emergency_mo_mt_call.py: using BVCI 40405 10:48:34.113386 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:48:34.124743 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:48:34.135962 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:48:34.147050 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:48:34.158259 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:48:34.169327 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:48:34.287419 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:48:34.407593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:34.906376 run create_hlr_db(pid=10061): Launched 10:48:35.038849 bus /sierra_2: Setting Powered False 10:48:36.103135 run create_hlr_db(pid=10061): Terminated: ok {rc=0} 10:48:36.554178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10063): Launched 10:48:36.876347 run osmo-hlr_10.42.42.2(pid=10064): Launched 10:48:36.999200 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:37.551277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10066): Launched 10:48:37.872772 run osmo-stp_10.42.42.5(pid=10067): Launched 10:48:38.008612 tst emergency_mo_mt_call.py: using MSISDN 8642 10:48:38.173282 run osmo-msc_10.42.42.6: Starting osmo-msc 10:48:38.756669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10069): Launched 10:48:39.080199 run osmo-msc_10.42.42.6(pid=10070): Launched 10:48:39.260179 run osmo-stp_10.42.42.5(pid=10067): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10067)] 10:48:39.395828 run osmo-stp_10.42.42.5(pid=10067): stdout: | (launched: 2022-12-14_10:48:37.813747) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:39.531445 run osmo-stp_10.42.42.5(pid=10067): stderr: | 20221214104838004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104838004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104838004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104838005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104838006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104838006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104838006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:39.666221 run osmo-stp_10.42.42.5(pid=10067): stdout: | (launched: 2022-12-14_10:48:37.813747) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:39.793941 run osmo-stp_10.42.42.5(pid=10067): stderr: | 20221214104838004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104838004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104838004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104838005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104838006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104838006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104838006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:39.947146 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10067): Process ended prematurely: osmo-stp_10.42.42.5(pid=10067) [trial-2403↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10067)] [trial-2403↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 10:48:39.956082 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 10:48:39.984126 run osmo-hlr_10.42.42.2(pid=10064): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10064)] 10:48:40.034995 run osmo-hlr_10.42.42.2(pid=10064): stdout: | (launched: 2022-12-14_10:48:36.816848) 10:48:40.087441 run osmo-hlr_10.42.42.2(pid=10064): stderr: | 20221214104837011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104837011 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104837011 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104837011 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104837011 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104837011 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104837023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104837032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104837032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104837032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:40.160552 run osmo-msc_10.42.42.6(pid=10070): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10070)] 10:48:40.211100 run osmo-msc_10.42.42.6(pid=10070): stdout: | (launched: 2022-12-14_10:48:39.020588) 10:48:40.263643 run osmo-msc_10.42.42.6(pid=10070): stderr: | 20221214104839341 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104839341 DLGLOBAL DEBUG validating counter group 0x7ff7f5b51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104839341 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104839341 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104839341 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104839342 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104839344 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104839344 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104839344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104839344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:48:40.316588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10063): Terminating (SIGTERM) 10:48:40.358672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10066): Terminating (SIGTERM) 10:48:40.400824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10069): Terminating (SIGTERM) 10:48:40.443506 --- ParallelTerminationStrategy: PID 10063 died... 10:48:40.463957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10063): Terminated: ok {rc=0} 10:48:40.510835 --- ParallelTerminationStrategy: PID 10066 died... 10:48:40.530637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10066): Terminated: ok {rc=0} 10:48:40.577472 --- ParallelTerminationStrategy: PID 10069 died... 10:48:40.597295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10069): Terminated: ok {rc=0} 10:48:40.687654 bus /sierra_3: Setting Powered False 10:48:41.786929 bus /sierra_3: Setting Powered False 10:48:42.902712 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 10:48:43.990606 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:48:44.002159 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:48:44.049080 tst emergency_preemptive_call.py: using LAC 40405 10:48:44.166316 tst emergency_preemptive_call.py: using RAC 115 10:48:44.289376 tst emergency_preemptive_call.py: using CellId 40405 10:48:44.405694 tst emergency_preemptive_call.py: using BVCI 40406 10:48:44.523017 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:48:44.534680 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:48:44.546017 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:48:44.557350 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:48:44.568756 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:48:44.580019 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:48:44.698250 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:48:44.814918 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:48:44.934609 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:48:45.051692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:45.519704 run create_hlr_db(pid=10072): Launched 10:48:45.651798 bus /sierra_2: Setting Powered False 10:48:46.717336 run create_hlr_db(pid=10072): Terminated: ok {rc=0} 10:48:47.174382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10074): Launched 10:48:47.491374 run osmo-hlr_10.42.42.2(pid=10075): Launched 10:48:47.607500 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:48.138984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10077): Launched 10:48:48.442983 run osmo-stp_10.42.42.5(pid=10078): Launched 10:48:48.566928 tst emergency_preemptive_call.py: using MSISDN 8643 10:48:48.720564 run osmo-msc_10.42.42.6: Starting osmo-msc 10:48:49.261012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10080): Launched 10:48:49.561811 run osmo-msc_10.42.42.6(pid=10081): Launched 10:48:49.730999 run osmo-stp_10.42.42.5(pid=10078): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10078)] 10:48:49.858244 run osmo-stp_10.42.42.5(pid=10078): stdout: | (launched: 2022-12-14_10:48:48.387008) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:49.985122 run osmo-stp_10.42.42.5(pid=10078): stderr: | 20221214104848556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104848556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104848556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104848557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104848558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104848558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104848558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:50.110158 run osmo-stp_10.42.42.5(pid=10078): stdout: | (launched: 2022-12-14_10:48:48.387008) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:50.229478 run osmo-stp_10.42.42.5(pid=10078): stderr: | 20221214104848556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104848556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104848556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104848557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104848558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104848558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104848558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:50.372309 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10078): Process ended prematurely: osmo-stp_10.42.42.5(pid=10078) [trial-2403↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10078)] [trial-2403↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 10:48:50.380762 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 10:48:50.407246 run osmo-hlr_10.42.42.2(pid=10075): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10075)] 10:48:50.455890 run osmo-hlr_10.42.42.2(pid=10075): stdout: | (launched: 2022-12-14_10:48:47.435148) 10:48:50.505972 run osmo-hlr_10.42.42.2(pid=10075): stderr: | 20221214104847607 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104847607 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104847607 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104847607 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104847607 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104847607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104847619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104847627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104847628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104847628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:50.576238 run osmo-msc_10.42.42.6(pid=10081): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10081)] 10:48:50.623943 run osmo-msc_10.42.42.6(pid=10081): stdout: | (launched: 2022-12-14_10:48:49.505833) 10:48:50.674342 run osmo-msc_10.42.42.6(pid=10081): stderr: | 20221214104849777 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214104849777 DLGLOBAL DEBUG validating counter group 0x7f5c7aa4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214104849777 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214104849777 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214104849778 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214104849778 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214104849779 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214104849780 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214104849780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214104849780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:48:50.724704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10074): Terminating (SIGTERM) 10:48:50.764822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10077): Terminating (SIGTERM) 10:48:50.805019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10080): Terminating (SIGTERM) 10:48:50.845622 --- ParallelTerminationStrategy: PID 10074 died... 10:48:50.865321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10074): Terminated: ok {rc=0} 10:48:50.909771 --- ParallelTerminationStrategy: PID 10077 died... 10:48:50.928647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10077): Terminated: ok {rc=0} 10:48:50.973234 --- ParallelTerminationStrategy: PID 10080 died... 10:48:50.992232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10080): Terminated: ok {rc=0} 10:48:51.079134 bus /sierra_9: Setting Powered False 10:48:52.178933 bus /sierra_9: Setting Powered False 10:48:53.291765 bus /sierra_8: Setting Powered False 10:48:54.390242 bus /sierra_8: Setting Powered False 10:48:55.506498 bus /sierra_3: Setting Powered False 10:48:56.604416 bus /sierra_3: Setting Powered False 10:48:57.721809 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 10:48:59.003082 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:48:59.007806 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:48:59.037573 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 10:48:59.077248 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 10:48:59.164490 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:48:59.194675 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 10:48:59.234034 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 10:48:59.828608 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 10:48:59.881683 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:48:59.892825 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:48:59.936928 tst cs_paging_gprs_active.py: using LAC 40406 10:49:00.063629 tst cs_paging_gprs_active.py: using RAC 116 10:49:00.189818 tst cs_paging_gprs_active.py: using CellId 40406 10:49:00.316472 tst cs_paging_gprs_active.py: using BVCI 40407 10:49:00.435058 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:00.446481 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:00.457653 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:00.468595 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:00.479657 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:00.490693 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:00.501898 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:00.512909 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:00.524345 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:49:00.642805 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:49:00.765735 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:49:00.994067 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:01.312204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10086): Launched 10:49:01.603232 run iperf3-srv_10.42.42.10(pid=10087): Launched 10:49:01.740147 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:49:01.967233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:02.301092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10088): Launched 10:49:02.588327 run iperf3-srv_10.42.42.10(pid=10089): Launched 10:49:02.710616 tst cs_paging_gprs_active.py:38: start network... 10:49:02.930737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:03.436799 run create_hlr_db(pid=10090): Launched 10:49:03.570382 bus /sierra_2: Setting Powered False 10:49:04.634762 run create_hlr_db(pid=10090): Terminated: ok {rc=0} 10:49:05.071794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10092): Launched 10:49:05.380033 run osmo-hlr_10.42.42.2(pid=10093): Launched 10:49:05.497545 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:06.037042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10095): Launched 10:49:06.345430 run osmo-stp_10.42.42.5(pid=10096): Launched 10:49:06.462069 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:06.991357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10098): Launched 10:49:07.109198 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:07.369682 run patchelf(pid=10099): Launched 10:49:07.541513 run osmo-stp_10.42.42.5(pid=10096): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10096)] 10:49:07.672909 run osmo-stp_10.42.42.5(pid=10096): stdout: | (launched: 2022-12-14_10:49:06.287843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:07.804708 run osmo-stp_10.42.42.5(pid=10096): stderr: | 20221214104906457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104906457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104906457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104906458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104906458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104906458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104906458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:07.936786 run osmo-stp_10.42.42.5(pid=10096): stdout: | (launched: 2022-12-14_10:49:06.287843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:08.062460 run osmo-stp_10.42.42.5(pid=10096): stderr: | 20221214104906457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104906457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104906457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104906458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104906458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104906458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104906458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:08.211185 run patchelf(pid=10099): Terminating (SIGINT) 10:49:08.384767 run patchelf(pid=10099): Terminated: ok {rc=0} 10:49:08.509576 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10096): Process ended prematurely: osmo-stp_10.42.42.5(pid=10096) [trial-2403↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10096)] [trial-2403↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 10:49:08.519197 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:49:08.546640 run osmo-hlr_10.42.42.2(pid=10093): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10093)] 10:49:08.594941 run osmo-hlr_10.42.42.2(pid=10093): stdout: | (launched: 2022-12-14_10:49:05.322744) 10:49:08.644587 run osmo-hlr_10.42.42.2(pid=10093): stderr: | 20221214104905496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104905496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104905496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104905496 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104905496 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104905496 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104905509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104905517 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104905518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104905518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:08.694685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10086): Terminating (SIGTERM) 10:49:08.734968 run iperf3-srv_10.42.42.10(pid=10087): Terminating (SIGTERM) 10:49:08.775112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10088): Terminating (SIGTERM) 10:49:08.815636 run iperf3-srv_10.42.42.10(pid=10089): Terminating (SIGTERM) 10:49:08.855579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10092): Terminating (SIGTERM) 10:49:08.895579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10095): Terminating (SIGTERM) 10:49:08.935693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10098): Terminating (SIGTERM) 10:49:08.976096 --- ParallelTerminationStrategy: PID 10086 died... 10:49:08.995891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10086): Terminated: ok {rc=0} 10:49:09.040562 --- ParallelTerminationStrategy: PID 10087 died... 10:49:09.059763 run iperf3-srv_10.42.42.10(pid=10087): Terminated {rc=256} 10:49:09.104001 --- ParallelTerminationStrategy: PID 10088 died... 10:49:09.123089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10088): Terminated: ok {rc=0} 10:49:09.167878 --- ParallelTerminationStrategy: PID 10089 died... 10:49:09.186891 run iperf3-srv_10.42.42.10(pid=10089): Terminated {rc=256} 10:49:09.231101 --- ParallelTerminationStrategy: PID 10092 died... 10:49:09.250190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10092): Terminated: ok {rc=0} 10:49:09.294462 --- ParallelTerminationStrategy: PID 10095 died... 10:49:09.313641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10095): Terminated: ok {rc=0} 10:49:09.358032 --- ParallelTerminationStrategy: PID 10098 died... 10:49:09.377026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10098): Terminated: ok {rc=0} 10:49:09.464001 bus /gobi_0: Setting Powered False 10:49:10.564116 bus /gobi_0: Setting Powered False 10:49:11.679854 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 10:49:12.831933 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:12.843956 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:49:12.892541 tst iperf3.py: using LAC 40407 10:49:13.024023 tst iperf3.py: using RAC 117 10:49:13.150980 tst iperf3.py: using CellId 40407 10:49:13.276479 tst iperf3.py: using BVCI 40408 10:49:13.397095 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:13.408334 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:13.419454 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:13.430478 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:13.441461 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:13.452408 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:13.463636 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:13.474670 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:13.485898 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:49:13.602162 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:49:13.821923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:14.150668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10100): Launched 10:49:14.435633 run iperf3-srv_10.42.42.10(pid=10101): Launched 10:49:14.558142 tst iperf3.py:8: start network... 10:49:14.777846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:15.283076 run create_hlr_db(pid=10102): Launched 10:49:15.416438 bus /gobi_6: Setting Powered False 10:49:16.479433 run create_hlr_db(pid=10102): Terminated: ok {rc=0} 10:49:16.943152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10104): Launched 10:49:17.310765 run osmo-hlr_10.42.42.2(pid=10105): Launched 10:49:17.427892 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:17.957208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10107): Launched 10:49:18.265793 run osmo-stp_10.42.42.5(pid=10108): Launched 10:49:18.383037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:18.914144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10110): Launched 10:49:19.032233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:19.291720 run patchelf(pid=10111): Launched 10:49:19.462998 run osmo-stp_10.42.42.5(pid=10108): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10108)] 10:49:19.592495 run osmo-stp_10.42.42.5(pid=10108): stdout: | (launched: 2022-12-14_10:49:18.208260) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:19.723811 run osmo-stp_10.42.42.5(pid=10108): stderr: | 20221214104918379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104918379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104918379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104918380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104918380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104918380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104918380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:19.855009 run osmo-stp_10.42.42.5(pid=10108): stdout: | (launched: 2022-12-14_10:49:18.208260) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:19.980149 run osmo-stp_10.42.42.5(pid=10108): stderr: | 20221214104918379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104918379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104918379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104918380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104918380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104918380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104918380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:20.128566 run patchelf(pid=10111): Terminating (SIGINT) 10:49:20.301228 run patchelf(pid=10111): Terminated: ok {rc=0} 10:49:20.425955 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10108): Process ended prematurely: osmo-stp_10.42.42.5(pid=10108) [trial-2403↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10108)] [trial-2403↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 10:49:20.435524 tst iperf3.py:8: Test FAILED (7.6 sec) 10:49:20.463096 run osmo-hlr_10.42.42.2(pid=10105): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10105)] 10:49:20.511483 run osmo-hlr_10.42.42.2(pid=10105): stdout: | (launched: 2022-12-14_10:49:17.251804) 10:49:20.561541 run osmo-hlr_10.42.42.2(pid=10105): stderr: | 20221214104917427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104917427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104917427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104917427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104917427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104917427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104917473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104917485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104917485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104917485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:20.611746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10100): Terminating (SIGTERM) 10:49:20.652387 run iperf3-srv_10.42.42.10(pid=10101): Terminating (SIGTERM) 10:49:20.693068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10104): Terminating (SIGTERM) 10:49:20.733408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10107): Terminating (SIGTERM) 10:49:20.773557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10110): Terminating (SIGTERM) 10:49:20.814147 --- ParallelTerminationStrategy: PID 10100 died... 10:49:20.833923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10100): Terminated: ok {rc=0} 10:49:20.879252 --- ParallelTerminationStrategy: PID 10101 died... 10:49:20.898709 run iperf3-srv_10.42.42.10(pid=10101): Terminated {rc=256} 10:49:20.943055 --- ParallelTerminationStrategy: PID 10104 died... 10:49:20.962314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10104): Terminated: ok {rc=0} 10:49:21.006738 --- ParallelTerminationStrategy: PID 10107 died... 10:49:21.025943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10107): Terminated: ok {rc=0} 10:49:21.070265 --- ParallelTerminationStrategy: PID 10110 died... 10:49:21.089572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10110): Terminated: ok {rc=0} 10:49:21.176628 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 10:49:22.325267 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:22.336701 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:49:22.383143 tst iperf3m4.py: using LAC 40408 10:49:22.503862 tst iperf3m4.py: using RAC 118 10:49:22.633643 tst iperf3m4.py: using CellId 40408 10:49:22.754225 tst iperf3m4.py: using BVCI 40409 10:49:22.866874 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:22.877788 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:22.888427 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:22.899175 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:22.910070 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:22.921389 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:22.932770 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:22.943584 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:22.954606 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:49:23.076446 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:49:23.196449 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:49:23.317216 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:49:23.443439 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:49:23.663243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:23.992805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10112): Launched 10:49:24.278917 run iperf3-srv_10.42.42.10(pid=10113): Launched 10:49:24.402609 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:49:24.622490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:24.951473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10114): Launched 10:49:25.236583 run iperf3-srv_10.42.42.10(pid=10115): Launched 10:49:25.359686 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:49:25.579628 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:25.908781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10116): Launched 10:49:26.194554 run iperf3-srv_10.42.42.10(pid=10117): Launched 10:49:26.317458 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:49:26.536670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:49:26.866240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10118): Launched 10:49:27.153513 run iperf3-srv_10.42.42.10(pid=10119): Launched 10:49:27.276160 tst iperf3m4.py:8: start network... 10:49:27.497193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:28.003763 run create_hlr_db(pid=10120): Launched 10:49:28.136264 bus /gobi_6: Setting Powered False 10:49:29.198055 run create_hlr_db(pid=10120): Terminated: ok {rc=0} 10:49:29.652587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10122): Launched 10:49:29.981534 run osmo-hlr_10.42.42.2(pid=10123): Launched 10:49:30.105638 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:30.779510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10125): Launched 10:49:31.126033 run osmo-stp_10.42.42.5(pid=10126): Launched 10:49:31.341719 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:32.002071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10128): Launched 10:49:32.136509 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:32.410328 run patchelf(pid=10129): Launched 10:49:32.590684 run osmo-stp_10.42.42.5(pid=10126): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10126)] 10:49:32.726131 run osmo-stp_10.42.42.5(pid=10126): stdout: | (launched: 2022-12-14_10:49:31.062756) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:32.863519 run osmo-stp_10.42.42.5(pid=10126): stderr: | 20221214104931362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104931363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104931363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104931363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104931364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104931364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104931364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:33.001328 run osmo-stp_10.42.42.5(pid=10126): stdout: | (launched: 2022-12-14_10:49:31.062756) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:33.132560 run osmo-stp_10.42.42.5(pid=10126): stderr: | 20221214104931362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104931363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104931363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104931363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104931364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104931364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104931364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:33.288063 run patchelf(pid=10129): Terminating (SIGINT) 10:49:33.468651 run patchelf(pid=10129): Terminated: ok {rc=0} 10:49:33.598880 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10126): Process ended prematurely: osmo-stp_10.42.42.5(pid=10126) [trial-2403↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10126)] [trial-2403↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 10:49:33.609388 tst iperf3m4.py:8: Test FAILED (11.3 sec) 10:49:33.638483 run osmo-hlr_10.42.42.2(pid=10123): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10123)] 10:49:33.688916 run osmo-hlr_10.42.42.2(pid=10123): stdout: | (launched: 2022-12-14_10:49:29.920320) 10:49:33.741241 run osmo-hlr_10.42.42.2(pid=10123): stderr: | 20221214104930116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104930116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104930116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104930116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104930116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104930116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104930129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104930138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104930138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104930138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:33.793775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10112): Terminating (SIGTERM) 10:49:33.835823 run iperf3-srv_10.42.42.10(pid=10113): Terminating (SIGTERM) 10:49:33.878121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10114): Terminating (SIGTERM) 10:49:33.920402 run iperf3-srv_10.42.42.10(pid=10115): Terminating (SIGTERM) 10:49:33.962129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10116): Terminating (SIGTERM) 10:49:34.003951 run iperf3-srv_10.42.42.10(pid=10117): Terminating (SIGTERM) 10:49:34.045510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10118): Terminating (SIGTERM) 10:49:34.087408 run iperf3-srv_10.42.42.10(pid=10119): Terminating (SIGTERM) 10:49:34.129622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10122): Terminating (SIGTERM) 10:49:34.171967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10125): Terminating (SIGTERM) 10:49:34.214267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10128): Terminating (SIGTERM) 10:49:34.256813 --- ParallelTerminationStrategy: PID 10112 died... 10:49:34.277134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10112): Terminated: ok {rc=0} 10:49:34.323707 --- ParallelTerminationStrategy: PID 10113 died... 10:49:34.343598 run iperf3-srv_10.42.42.10(pid=10113): Terminated {rc=256} 10:49:34.389580 --- ParallelTerminationStrategy: PID 10114 died... 10:49:34.409293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10114): Terminated: ok {rc=0} 10:49:34.455324 --- ParallelTerminationStrategy: PID 10115 died... 10:49:34.474912 run iperf3-srv_10.42.42.10(pid=10115): Terminated {rc=256} 10:49:34.520934 --- ParallelTerminationStrategy: PID 10116 died... 10:49:34.540681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10116): Terminated: ok {rc=0} 10:49:34.586843 --- ParallelTerminationStrategy: PID 10117 died... 10:49:34.606585 run iperf3-srv_10.42.42.10(pid=10117): Terminated {rc=256} 10:49:34.652591 --- ParallelTerminationStrategy: PID 10118 died... 10:49:34.672323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10118): Terminated: ok {rc=0} 10:49:34.718450 --- ParallelTerminationStrategy: PID 10119 died... 10:49:34.738314 run iperf3-srv_10.42.42.10(pid=10119): Terminated {rc=256} 10:49:34.784360 --- ParallelTerminationStrategy: PID 10122 died... 10:49:34.804164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10122): Terminated: ok {rc=0} 10:49:34.850493 --- ParallelTerminationStrategy: PID 10125 died... 10:49:34.870229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10125): Terminated: ok {rc=0} 10:49:34.916320 --- ParallelTerminationStrategy: PID 10128 died... 10:49:34.936003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10128): Terminated: ok {rc=0} 10:49:35.023858 bus /gobi_4: Setting Powered False 10:49:36.122947 bus /gobi_4: Setting Powered False 10:49:37.238683 bus /gobi_1: Setting Powered False 10:49:38.332760 bus /gobi_1: Setting Powered False 10:49:39.447996 bus /gobi_0: Setting Powered False 10:49:40.546139 bus /gobi_0: Setting Powered False 10:49:41.661064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 10:49:42.763571 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:42.774868 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:49:42.820024 tst ping.py: using LAC 40409 10:49:42.945149 tst ping.py: using RAC 119 10:49:43.062965 tst ping.py: using CellId 40409 10:49:43.179499 tst ping.py: using BVCI 40410 10:49:43.295381 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:43.306748 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:43.319045 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:43.330220 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:43.341189 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:43.352218 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:43.363343 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:43.374529 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:49:43.492263 tst ping.py:19: start network... 10:49:43.692840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:44.154491 run create_hlr_db(pid=10130): Launched 10:49:44.286987 bus /gobi_6: Setting Powered False 10:49:45.350426 run create_hlr_db(pid=10130): Terminated: ok {rc=0} 10:49:45.791463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10132): Launched 10:49:46.117492 run osmo-hlr_10.42.42.2(pid=10133): Launched 10:49:46.389925 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:47.149812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10135): Launched 10:49:47.462658 run osmo-stp_10.42.42.5(pid=10136): Launched 10:49:47.582973 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:48.097847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10138): Launched 10:49:48.211980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:48.463638 run patchelf(pid=10139): Launched 10:49:48.629651 run osmo-stp_10.42.42.5(pid=10136): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10136)] 10:49:48.755389 run osmo-stp_10.42.42.5(pid=10136): stdout: | (launched: 2022-12-14_10:49:47.406868) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:48.883521 run osmo-stp_10.42.42.5(pid=10136): stderr: | 20221214104947573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104947573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104947574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104947574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104947574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104947575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104947575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:49.011740 run osmo-stp_10.42.42.5(pid=10136): stdout: | (launched: 2022-12-14_10:49:47.406868) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:49.133736 run osmo-stp_10.42.42.5(pid=10136): stderr: | 20221214104947573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104947573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104947574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104947574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104947574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104947575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104947575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:49.277754 run patchelf(pid=10139): Terminating (SIGINT) 10:49:49.444848 run patchelf(pid=10139): Terminated: ok {rc=0} 10:49:49.566020 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10136): Process ended prematurely: osmo-stp_10.42.42.5(pid=10136) [trial-2403↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10136)] [trial-2403↪gprs:trx-lms-limenet-micro↪ping.py:22] 10:49:49.575061 tst ping.py:22: Test FAILED (6.8 sec) 10:49:49.601719 run osmo-hlr_10.42.42.2(pid=10133): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10133)] 10:49:49.649943 run osmo-hlr_10.42.42.2(pid=10133): stdout: | (launched: 2022-12-14_10:49:46.054967) 10:49:49.699713 run osmo-hlr_10.42.42.2(pid=10133): stderr: | 20221214104946392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104946392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104946392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104946392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104946392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104946392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104946419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104946447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104946448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104946449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:49.749861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10132): Terminating (SIGTERM) 10:49:49.789977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10135): Terminating (SIGTERM) 10:49:49.830150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10138): Terminating (SIGTERM) 10:49:49.870533 --- ParallelTerminationStrategy: PID 10132 died... 10:49:49.890200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10132): Terminated: ok {rc=0} 10:49:49.934451 --- ParallelTerminationStrategy: PID 10135 died... 10:49:49.953237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10135): Terminated: ok {rc=0} 10:49:49.997310 --- ParallelTerminationStrategy: PID 10138 died... 10:49:50.016270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10138): Terminated: ok {rc=0} 10:49:50.103330 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 10:49:51.192425 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:51.204321 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:49:51.250975 tst ping_idle_ping.py: using LAC 40410 10:49:51.370012 tst ping_idle_ping.py: using RAC 120 10:49:51.486214 tst ping_idle_ping.py: using CellId 40410 10:49:51.604940 tst ping_idle_ping.py: using BVCI 40411 10:49:51.712852 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:51.723638 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:51.734319 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:51.744820 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:51.755277 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:51.766357 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:51.777992 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:49:51.789351 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:49:51.907247 tst ping_idle_ping.py:24: start network... 10:49:52.120941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:52.615053 run create_hlr_db(pid=10140): Launched 10:49:52.744294 bus /gobi_6: Setting Powered False 10:49:53.808167 run create_hlr_db(pid=10140): Terminated: ok {rc=0} 10:49:54.236910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10142): Launched 10:49:54.537975 run osmo-hlr_10.42.42.2(pid=10143): Launched 10:49:54.653325 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:55.186629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10145): Launched 10:49:55.489701 run osmo-stp_10.42.42.5(pid=10146): Launched 10:49:55.605719 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:49:56.121522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10148): Launched 10:49:56.236395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:49:56.489743 run patchelf(pid=10149): Launched 10:49:56.656631 run osmo-stp_10.42.42.5(pid=10146): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10146)] 10:49:56.783447 run osmo-stp_10.42.42.5(pid=10146): stdout: | (launched: 2022-12-14_10:49:55.433764) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:56.912540 run osmo-stp_10.42.42.5(pid=10146): stderr: | 20221214104955604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104955604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104955604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104955605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104955605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104955605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104955606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:57.041678 run osmo-stp_10.42.42.5(pid=10146): stdout: | (launched: 2022-12-14_10:49:55.433764) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:57.165130 run osmo-stp_10.42.42.5(pid=10146): stderr: | 20221214104955604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214104955604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214104955604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214104955605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214104955605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214104955605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214104955606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:57.311009 run patchelf(pid=10149): Terminating (SIGINT) 10:49:57.479424 run patchelf(pid=10149): Terminated: ok {rc=0} 10:49:57.601311 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10146): Process ended prematurely: osmo-stp_10.42.42.5(pid=10146) [trial-2403↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10146)] [trial-2403↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 10:49:57.610443 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:49:57.637169 run osmo-hlr_10.42.42.2(pid=10143): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10143)] 10:49:57.685504 run osmo-hlr_10.42.42.2(pid=10143): stdout: | (launched: 2022-12-14_10:49:54.481775) 10:49:57.735342 run osmo-hlr_10.42.42.2(pid=10143): stderr: | 20221214104954657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214104954657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214104954657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214104954657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214104954657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214104954657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214104954674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214104954684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214104954684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214104954684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:57.785558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10142): Terminating (SIGTERM) 10:49:57.825787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10145): Terminating (SIGTERM) 10:49:57.865831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10148): Terminating (SIGTERM) 10:49:57.906121 --- ParallelTerminationStrategy: PID 10142 died... 10:49:57.925692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10142): Terminated: ok {rc=0} 10:49:57.969812 --- ParallelTerminationStrategy: PID 10145 died... 10:49:57.988611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10145): Terminated: ok {rc=0} 10:49:58.032575 --- ParallelTerminationStrategy: PID 10148 died... 10:49:58.051388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10148): Terminated: ok {rc=0} 10:49:58.134911 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 10:49:59.435814 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:49:59.441719 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:49:59.471307 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:49:59.510937 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:49:59.601279 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:49:59.631541 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:49:59.670701 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:50:00.266156 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:50:00.318203 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:00.329632 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:50:00.377744 tst cs_paging_gprs_active.py: using LAC 40411 10:50:00.505153 tst cs_paging_gprs_active.py: using RAC 121 10:50:00.629820 tst cs_paging_gprs_active.py: using CellId 40411 10:50:00.750032 tst cs_paging_gprs_active.py: using BVCI 40412 10:50:00.869432 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:00.881025 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:00.892301 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:00.903796 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:00.915693 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:00.927588 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:00.939595 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:00.951339 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:00.963249 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:50:01.101234 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:50:01.224929 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:50:01.451632 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:50:01.794312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10157): Launched 10:50:02.094545 run iperf3-srv_10.42.42.10(pid=10158): Launched 10:50:02.232690 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:50:02.452055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:50:02.778383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10159): Launched 10:50:03.061885 run iperf3-srv_10.42.42.10(pid=10160): Launched 10:50:03.183128 tst cs_paging_gprs_active.py:38: start network... 10:50:03.402071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:03.904102 run create_hlr_db(pid=10161): Launched 10:50:04.037944 bus /gobi_6: Setting Powered False 10:50:05.102223 run create_hlr_db(pid=10161): Terminated: ok {rc=0} 10:50:05.540623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10163): Launched 10:50:05.847214 run osmo-hlr_10.42.42.2(pid=10164): Launched 10:50:05.963685 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:06.500280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10166): Launched 10:50:06.808728 run osmo-stp_10.42.42.5(pid=10167): Launched 10:50:06.925510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:50:07.454173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10169): Launched 10:50:07.571823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:50:07.830988 run patchelf(pid=10170): Launched 10:50:08.001927 run osmo-stp_10.42.42.5(pid=10167): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10167)] 10:50:08.132370 run osmo-stp_10.42.42.5(pid=10167): stdout: | (launched: 2022-12-14_10:50:06.751651) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:08.263845 run osmo-stp_10.42.42.5(pid=10167): stderr: | 20221214105006920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105006920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105006920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105006920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105006921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105006921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105006921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:08.394606 run osmo-stp_10.42.42.5(pid=10167): stdout: | (launched: 2022-12-14_10:50:06.751651) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:08.519682 run osmo-stp_10.42.42.5(pid=10167): stderr: | 20221214105006920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105006920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105006920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105006920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105006921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105006921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105006921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:08.667513 run patchelf(pid=10170): Terminating (SIGINT) 10:50:08.839215 run patchelf(pid=10170): Terminated: ok {rc=0} 10:50:08.962577 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10167): Process ended prematurely: osmo-stp_10.42.42.5(pid=10167) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10167)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:50:08.972131 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:50:08.999508 run osmo-hlr_10.42.42.2(pid=10164): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10164)] 10:50:09.047907 run osmo-hlr_10.42.42.2(pid=10164): stdout: | (launched: 2022-12-14_10:50:05.790467) 10:50:09.097866 run osmo-hlr_10.42.42.2(pid=10164): stderr: | 20221214105005965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105005965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105005965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105005965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105005965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105005965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105005978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105005987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105005988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105005988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:09.148189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10157): Terminating (SIGTERM) 10:50:09.188361 run iperf3-srv_10.42.42.10(pid=10158): Terminating (SIGTERM) 10:50:09.228389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10159): Terminating (SIGTERM) 10:50:09.268775 run iperf3-srv_10.42.42.10(pid=10160): Terminating (SIGTERM) 10:50:09.308852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10163): Terminating (SIGTERM) 10:50:09.349044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10166): Terminating (SIGTERM) 10:50:09.389113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10169): Terminating (SIGTERM) 10:50:09.429369 --- ParallelTerminationStrategy: PID 10157 died... 10:50:09.448824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10157): Terminated: ok {rc=0} 10:50:09.492931 --- ParallelTerminationStrategy: PID 10158 died... 10:50:09.511694 run iperf3-srv_10.42.42.10(pid=10158): Terminated {rc=256} 10:50:09.555338 --- ParallelTerminationStrategy: PID 10159 died... 10:50:09.574219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10159): Terminated: ok {rc=0} 10:50:09.618517 --- ParallelTerminationStrategy: PID 10160 died... 10:50:09.637457 run iperf3-srv_10.42.42.10(pid=10160): Terminated {rc=256} 10:50:09.681156 --- ParallelTerminationStrategy: PID 10163 died... 10:50:09.699987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10163): Terminated: ok {rc=0} 10:50:09.744035 --- ParallelTerminationStrategy: PID 10166 died... 10:50:09.763023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10166): Terminated: ok {rc=0} 10:50:09.807139 --- ParallelTerminationStrategy: PID 10169 died... 10:50:09.826176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10169): Terminated: ok {rc=0} 10:50:09.912597 bus /gobi_0: Setting Powered False 10:50:11.012173 bus /gobi_0: Setting Powered False 10:50:12.129319 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:50:13.278347 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:13.290775 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:50:13.339970 tst iperf3.py: using LAC 40412 10:50:13.468165 tst iperf3.py: using RAC 122 10:50:13.594099 tst iperf3.py: using CellId 40412 10:50:13.723493 tst iperf3.py: using BVCI 40413 10:50:13.842300 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:13.853822 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:13.865184 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:13.876451 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:13.887685 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:13.898996 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:13.910465 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:13.921704 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:13.933040 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:50:14.053094 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:50:14.271330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:50:14.597208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10171): Launched 10:50:14.879907 run iperf3-srv_10.42.42.10(pid=10172): Launched 10:50:15.002630 tst iperf3.py:8: start network... 10:50:15.220624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:15.723241 run create_hlr_db(pid=10173): Launched 10:50:15.862586 bus /gobi_6: Setting Powered False 10:50:16.933549 run create_hlr_db(pid=10173): Terminated: ok {rc=0} 10:50:17.393224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10175): Launched 10:50:17.718375 run osmo-hlr_10.42.42.2(pid=10176): Launched 10:50:17.843124 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:18.398614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10178): Launched 10:50:18.722407 run osmo-stp_10.42.42.5(pid=10179): Launched 10:50:18.845546 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:50:19.402795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10181): Launched 10:50:19.526916 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:50:19.799615 run patchelf(pid=10182): Launched 10:50:19.980701 run osmo-stp_10.42.42.5(pid=10179): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10179)] 10:50:20.117202 run osmo-stp_10.42.42.5(pid=10179): stdout: | (launched: 2022-12-14_10:50:18.662808) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:20.255438 run osmo-stp_10.42.42.5(pid=10179): stderr: | 20221214105018852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105018852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105018852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105018853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105018853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105018853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105018854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:20.394323 run osmo-stp_10.42.42.5(pid=10179): stdout: | (launched: 2022-12-14_10:50:18.662808) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:20.525768 run osmo-stp_10.42.42.5(pid=10179): stderr: | 20221214105018852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105018852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105018852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105018853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105018853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105018853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105018854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:20.682275 run patchelf(pid=10182): Terminating (SIGINT) 10:50:20.863112 run patchelf(pid=10182): Terminated: ok {rc=0} 10:50:20.993265 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10179): Process ended prematurely: osmo-stp_10.42.42.5(pid=10179) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10179)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 10:50:21.003516 tst iperf3.py:8: Test FAILED (7.8 sec) 10:50:21.032252 run osmo-hlr_10.42.42.2(pid=10176): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10176)] 10:50:21.082555 run osmo-hlr_10.42.42.2(pid=10176): stdout: | (launched: 2022-12-14_10:50:17.658549) 10:50:21.134861 run osmo-hlr_10.42.42.2(pid=10176): stderr: | 20221214105017853 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105017853 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105017853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105017853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105017853 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105017853 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105017866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105017874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105017875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105017875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:21.187205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10171): Terminating (SIGTERM) 10:50:21.229025 run iperf3-srv_10.42.42.10(pid=10172): Terminating (SIGTERM) 10:50:21.270931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10175): Terminating (SIGTERM) 10:50:21.313053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10178): Terminating (SIGTERM) 10:50:21.354967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10181): Terminating (SIGTERM) 10:50:21.397555 --- ParallelTerminationStrategy: PID 10171 died... 10:50:21.417580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10171): Terminated: ok {rc=0} 10:50:21.463693 --- ParallelTerminationStrategy: PID 10172 died... 10:50:21.483243 run iperf3-srv_10.42.42.10(pid=10172): Terminated {rc=256} 10:50:21.529209 --- ParallelTerminationStrategy: PID 10175 died... 10:50:21.548681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10175): Terminated: ok {rc=0} 10:50:21.594842 --- ParallelTerminationStrategy: PID 10178 died... 10:50:21.614236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10178): Terminated: ok {rc=0} 10:50:21.659991 --- ParallelTerminationStrategy: PID 10181 died... 10:50:21.679477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10181): Terminated: ok {rc=0} 10:50:21.767608 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:50:22.918817 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:22.930981 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:50:22.978623 tst iperf3m4.py: using LAC 40413 10:50:23.106414 tst iperf3m4.py: using RAC 123 10:50:23.233813 tst iperf3m4.py: using CellId 40413 10:50:23.360896 tst iperf3m4.py: using BVCI 40414 10:50:23.478303 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:23.489876 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:23.501166 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:23.512446 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:23.523796 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:23.535129 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:23.546565 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:23.557787 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:23.569699 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:50:23.694073 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:50:23.813784 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:50:23.931379 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:50:24.053225 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:50:24.270148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:50:24.594592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10183): Launched 10:50:24.878712 run iperf3-srv_10.42.42.10(pid=10184): Launched 10:50:25.001642 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:50:25.218406 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:50:25.544195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10185): Launched 10:50:25.826950 run iperf3-srv_10.42.42.10(pid=10186): Launched 10:50:25.949604 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:50:26.166451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:50:26.491566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10187): Launched 10:50:26.775945 run iperf3-srv_10.42.42.10(pid=10188): Launched 10:50:26.897301 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:50:27.113999 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:50:27.439996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10189): Launched 10:50:27.723700 run iperf3-srv_10.42.42.10(pid=10190): Launched 10:50:27.846162 tst iperf3m4.py:8: start network... 10:50:28.062858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:28.565687 run create_hlr_db(pid=10191): Launched 10:50:28.698702 bus /gobi_6: Setting Powered False 10:50:29.762070 run create_hlr_db(pid=10191): Terminated: ok {rc=0} 10:50:30.212055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10193): Launched 10:50:30.538830 run osmo-hlr_10.42.42.2(pid=10194): Launched 10:50:30.661061 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:31.228812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10196): Launched 10:50:31.567095 run osmo-stp_10.42.42.5(pid=10197): Launched 10:50:31.742644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:50:32.426823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10199): Launched 10:50:32.544117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:50:32.803059 run patchelf(pid=10200): Launched 10:50:32.975446 run osmo-stp_10.42.42.5(pid=10197): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10197)] 10:50:33.104662 run osmo-stp_10.42.42.5(pid=10197): stdout: | (launched: 2022-12-14_10:50:31.504133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:33.235566 run osmo-stp_10.42.42.5(pid=10197): stderr: | 20221214105031856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105031856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105031856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105031856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105031857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105031857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105031857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:33.366376 run osmo-stp_10.42.42.5(pid=10197): stdout: | (launched: 2022-12-14_10:50:31.504133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:33.491301 run osmo-stp_10.42.42.5(pid=10197): stderr: | 20221214105031856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105031856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105031856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105031856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105031857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105031857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105031857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:33.639259 run patchelf(pid=10200): Terminating (SIGINT) 10:50:33.810549 run patchelf(pid=10200): Terminated: ok {rc=0} 10:50:33.933995 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10197): Process ended prematurely: osmo-stp_10.42.42.5(pid=10197) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10197)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 10:50:33.943653 tst iperf3m4.py:8: Test FAILED (11.1 sec) 10:50:33.971166 run osmo-hlr_10.42.42.2(pid=10194): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10194)] 10:50:34.019391 run osmo-hlr_10.42.42.2(pid=10194): stdout: | (launched: 2022-12-14_10:50:30.479043) 10:50:34.069272 run osmo-hlr_10.42.42.2(pid=10194): stderr: | 20221214105030674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105030674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105030674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105030674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105030674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105030674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105030687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105030695 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105030696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105030696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:34.119381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10183): Terminating (SIGTERM) 10:50:34.159589 run iperf3-srv_10.42.42.10(pid=10184): Terminating (SIGTERM) 10:50:34.199729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10185): Terminating (SIGTERM) 10:50:34.239860 run iperf3-srv_10.42.42.10(pid=10186): Terminating (SIGTERM) 10:50:34.279860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10187): Terminating (SIGTERM) 10:50:34.320014 run iperf3-srv_10.42.42.10(pid=10188): Terminating (SIGTERM) 10:50:34.359982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10189): Terminating (SIGTERM) 10:50:34.400078 run iperf3-srv_10.42.42.10(pid=10190): Terminating (SIGTERM) 10:50:34.439931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10193): Terminating (SIGTERM) 10:50:34.480134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10196): Terminating (SIGTERM) 10:50:34.519983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10199): Terminating (SIGTERM) 10:50:34.559918 --- ParallelTerminationStrategy: PID 10183 died... 10:50:34.578946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10183): Terminated: ok {rc=0} 10:50:34.623099 --- ParallelTerminationStrategy: PID 10184 died... 10:50:34.641886 run iperf3-srv_10.42.42.10(pid=10184): Terminated {rc=256} 10:50:34.685897 --- ParallelTerminationStrategy: PID 10185 died... 10:50:34.704782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10185): Terminated: ok {rc=0} 10:50:34.749134 --- ParallelTerminationStrategy: PID 10186 died... 10:50:34.767837 run iperf3-srv_10.42.42.10(pid=10186): Terminated {rc=256} 10:50:34.811956 --- ParallelTerminationStrategy: PID 10187 died... 10:50:34.830833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10187): Terminated: ok {rc=0} 10:50:34.874826 --- ParallelTerminationStrategy: PID 10188 died... 10:50:34.893594 run iperf3-srv_10.42.42.10(pid=10188): Terminated {rc=256} 10:50:34.937383 --- ParallelTerminationStrategy: PID 10189 died... 10:50:34.956271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10189): Terminated: ok {rc=0} 10:50:35.000352 --- ParallelTerminationStrategy: PID 10190 died... 10:50:35.019251 run iperf3-srv_10.42.42.10(pid=10190): Terminated {rc=256} 10:50:35.063149 --- ParallelTerminationStrategy: PID 10193 died... 10:50:35.082089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10193): Terminated: ok {rc=0} 10:50:35.126113 --- ParallelTerminationStrategy: PID 10196 died... 10:50:35.145056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10196): Terminated: ok {rc=0} 10:50:35.189049 --- ParallelTerminationStrategy: PID 10199 died... 10:50:35.207833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10199): Terminated: ok {rc=0} 10:50:35.292368 bus /gobi_4: Setting Powered False 10:50:36.391328 bus /gobi_4: Setting Powered False 10:50:37.511562 bus /gobi_1: Setting Powered False 10:50:38.611186 bus /gobi_1: Setting Powered False 10:50:39.728224 bus /gobi_0: Setting Powered False 10:50:40.826739 bus /gobi_0: Setting Powered False 10:50:41.959965 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 10:50:43.064012 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:43.076154 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:50:43.124161 tst ping.py: using LAC 40414 10:50:43.251412 tst ping.py: using RAC 124 10:50:43.376220 tst ping.py: using CellId 40414 10:50:43.501897 tst ping.py: using BVCI 40415 10:50:43.618754 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:43.630379 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:43.641792 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:43.653161 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:43.664833 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:43.676551 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:43.688522 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:43.700414 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:50:43.821887 tst ping.py:19: start network... 10:50:44.037888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:44.531937 run create_hlr_db(pid=10202): Launched 10:50:44.662044 bus /gobi_6: Setting Powered False 10:50:45.724748 run create_hlr_db(pid=10202): Terminated: ok {rc=0} 10:50:46.184623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10204): Launched 10:50:46.509685 run osmo-hlr_10.42.42.2(pid=10205): Launched 10:50:46.629837 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:47.354189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10207): Launched 10:50:47.658253 run osmo-stp_10.42.42.5(pid=10208): Launched 10:50:47.772439 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:50:48.288680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10210): Launched 10:50:48.403882 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:50:48.657233 run patchelf(pid=10211): Launched 10:50:48.824256 run osmo-stp_10.42.42.5(pid=10208): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10208)] 10:50:48.951655 run osmo-stp_10.42.42.5(pid=10208): stdout: | (launched: 2022-12-14_10:50:47.602000) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:49.081178 run osmo-stp_10.42.42.5(pid=10208): stderr: | 20221214105047772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105047773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105047773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105047773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105047774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105047774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105047774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:49.210353 run osmo-stp_10.42.42.5(pid=10208): stdout: | (launched: 2022-12-14_10:50:47.602000) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:49.333419 run osmo-stp_10.42.42.5(pid=10208): stderr: | 20221214105047772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105047773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105047773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105047773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105047774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105047774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105047774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:49.479223 run patchelf(pid=10211): Terminating (SIGINT) 10:50:49.648099 run patchelf(pid=10211): Terminated: ok {rc=0} 10:50:49.769919 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10208): Process ended prematurely: osmo-stp_10.42.42.5(pid=10208) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10208)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 10:50:49.779000 tst ping.py:22: Test FAILED (6.7 sec) 10:50:49.806040 run osmo-hlr_10.42.42.2(pid=10205): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10205)] 10:50:49.854855 run osmo-hlr_10.42.42.2(pid=10205): stdout: | (launched: 2022-12-14_10:50:46.446778) 10:50:49.905297 run osmo-hlr_10.42.42.2(pid=10205): stderr: | 20221214105046778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105046778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105046778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105046778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105046778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105046778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105046802 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105046810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105046810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105046810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:49.955853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10204): Terminating (SIGTERM) 10:50:49.996539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10207): Terminating (SIGTERM) 10:50:50.036877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10210): Terminating (SIGTERM) 10:50:50.077621 --- ParallelTerminationStrategy: PID 10204 died... 10:50:50.097530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10204): Terminated: ok {rc=0} 10:50:50.142229 --- ParallelTerminationStrategy: PID 10207 died... 10:50:50.161487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10207): Terminated: ok {rc=0} 10:50:50.206055 --- ParallelTerminationStrategy: PID 10210 died... 10:50:50.225361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10210): Terminated: ok {rc=0} 10:50:50.312669 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:50:51.401889 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:51.413638 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:50:51.461139 tst ping_idle_ping.py: using LAC 40415 10:50:51.579277 tst ping_idle_ping.py: using RAC 125 10:50:51.698509 tst ping_idle_ping.py: using CellId 40415 10:50:51.815414 tst ping_idle_ping.py: using BVCI 40416 10:50:51.925655 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:51.936718 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:51.947690 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:51.958525 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:51.969575 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:51.981841 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:51.993218 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:50:52.004296 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:50:52.124636 tst ping_idle_ping.py:24: start network... 10:50:52.325297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:52.790936 run create_hlr_db(pid=10214): Launched 10:50:52.907130 bus /gobi_6: Setting Powered False 10:50:53.966750 run create_hlr_db(pid=10214): Terminated: ok {rc=0} 10:50:54.406934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10216): Launched 10:50:54.725750 run osmo-hlr_10.42.42.2(pid=10217): Launched 10:50:54.848740 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:55.396196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10219): Launched 10:50:55.716796 run osmo-stp_10.42.42.5(pid=10220): Launched 10:50:55.838829 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:50:56.389820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10222): Launched 10:50:56.511339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:50:56.780410 run patchelf(pid=10223): Launched 10:50:56.959814 run osmo-stp_10.42.42.5(pid=10220): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10220)] 10:50:57.095436 run osmo-stp_10.42.42.5(pid=10220): stdout: | (launched: 2022-12-14_10:50:55.658006) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:57.232397 run osmo-stp_10.42.42.5(pid=10220): stderr: | 20221214105055847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105055847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105055847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105055848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105055848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105055848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105055848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:57.370267 run osmo-stp_10.42.42.5(pid=10220): stdout: | (launched: 2022-12-14_10:50:55.658006) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:57.500757 run osmo-stp_10.42.42.5(pid=10220): stderr: | 20221214105055847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105055847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105055847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105055848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105055848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105055848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105055848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:57.655541 run patchelf(pid=10223): Terminating (SIGINT) 10:50:57.834463 run patchelf(pid=10223): Terminated: ok {rc=0} 10:50:57.963307 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10220): Process ended prematurely: osmo-stp_10.42.42.5(pid=10220) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10220)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 10:50:57.973160 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:50:58.001432 run osmo-hlr_10.42.42.2(pid=10217): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10217)] 10:50:58.051661 run osmo-hlr_10.42.42.2(pid=10217): stdout: | (launched: 2022-12-14_10:50:54.666691) 10:50:58.103904 run osmo-hlr_10.42.42.2(pid=10217): stderr: | 20221214105054861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105054861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105054861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105054861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105054861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105054861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105054874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105054882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105054882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105054882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:58.156607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10216): Terminating (SIGTERM) 10:50:58.198682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10219): Terminating (SIGTERM) 10:50:58.240746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10222): Terminating (SIGTERM) 10:50:58.283106 --- ParallelTerminationStrategy: PID 10216 died... 10:50:58.303443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10216): Terminated: ok {rc=0} 10:50:58.350772 --- ParallelTerminationStrategy: PID 10219 died... 10:50:58.370516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10219): Terminated: ok {rc=0} 10:50:58.416833 --- ParallelTerminationStrategy: PID 10222 died... 10:50:58.437076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10222): Terminated: ok {rc=0} 10:50:58.526082 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:50:59.834395 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:59.841893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:50:59.870489 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:50:59.909734 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:50:59.997556 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:51:00.026091 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:51:00.064111 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:51:00.660218 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:51:00.709633 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:00.720548 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:51:00.786126 tst cs_paging_gprs_active.py: using LAC 40416 10:51:00.919101 tst cs_paging_gprs_active.py: using RAC 126 10:51:01.059134 tst cs_paging_gprs_active.py: using CellId 40416 10:51:01.181920 tst cs_paging_gprs_active.py: using BVCI 40417 10:51:01.296822 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:01.308914 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:01.321013 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:01.333150 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:01.346636 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:01.359804 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:01.373149 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:01.386182 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:01.399306 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:51:01.520382 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:51:01.644196 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:51:01.898924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:02.236898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10227): Launched 10:51:02.515145 run iperf3-srv_10.42.42.10(pid=10228): Launched 10:51:02.633025 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:51:02.838887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:03.145680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10229): Launched 10:51:03.413690 run iperf3-srv_10.42.42.10(pid=10230): Launched 10:51:03.529995 tst cs_paging_gprs_active.py:38: start network... 10:51:03.735806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:04.211801 run create_hlr_db(pid=10231): Launched 10:51:04.329499 bus /gobi_6: Setting Powered False 10:51:05.394414 run create_hlr_db(pid=10231): Terminated: ok {rc=0} 10:51:05.849342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10233): Launched 10:51:06.177503 run osmo-hlr_10.42.42.2(pid=10234): Launched 10:51:06.303450 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:06.864058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10236): Launched 10:51:07.192891 run osmo-stp_10.42.42.5(pid=10237): Launched 10:51:07.316448 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:51:07.878617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10239): Launched 10:51:08.004851 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:51:08.281442 run patchelf(pid=10240): Launched 10:51:08.465305 run osmo-stp_10.42.42.5(pid=10237): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10237)] 10:51:08.603974 run osmo-stp_10.42.42.5(pid=10237): stdout: | (launched: 2022-12-14_10:51:07.132343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:08.743876 run osmo-stp_10.42.42.5(pid=10237): stderr: | 20221214105107324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105107324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105107324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105107325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105107325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105107325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105107325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:08.883390 run osmo-stp_10.42.42.5(pid=10237): stdout: | (launched: 2022-12-14_10:51:07.132343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:09.017484 run osmo-stp_10.42.42.5(pid=10237): stderr: | 20221214105107324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105107324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105107324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105107325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105107325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105107325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105107325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:09.176014 run patchelf(pid=10240): Terminating (SIGINT) 10:51:09.360223 run patchelf(pid=10240): Terminated: ok {rc=0} 10:51:09.492544 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10237): Process ended prematurely: osmo-stp_10.42.42.5(pid=10237) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10237)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:51:09.503044 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:51:09.531964 run osmo-hlr_10.42.42.2(pid=10234): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10234)] 10:51:09.582645 run osmo-hlr_10.42.42.2(pid=10234): stdout: | (launched: 2022-12-14_10:51:06.117264) 10:51:09.635028 run osmo-hlr_10.42.42.2(pid=10234): stderr: | 20221214105106315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105106315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105106315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105106315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105106315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105106315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105106331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105106340 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105106340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105106340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:09.688121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10227): Terminating (SIGTERM) 10:51:09.730522 run iperf3-srv_10.42.42.10(pid=10228): Terminating (SIGTERM) 10:51:09.773213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10229): Terminating (SIGTERM) 10:51:09.815953 run iperf3-srv_10.42.42.10(pid=10230): Terminating (SIGTERM) 10:51:09.858140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10233): Terminating (SIGTERM) 10:51:09.900998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10236): Terminating (SIGTERM) 10:51:09.943534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10239): Terminating (SIGTERM) 10:51:09.986165 --- ParallelTerminationStrategy: PID 10227 died... 10:51:10.006700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10227): Terminated: ok {rc=0} 10:51:10.053551 --- ParallelTerminationStrategy: PID 10228 died... 10:51:10.073314 run iperf3-srv_10.42.42.10(pid=10228): Terminated {rc=256} 10:51:10.119716 --- ParallelTerminationStrategy: PID 10229 died... 10:51:10.139579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10229): Terminated: ok {rc=0} 10:51:10.185807 --- ParallelTerminationStrategy: PID 10230 died... 10:51:10.205663 run iperf3-srv_10.42.42.10(pid=10230): Terminated {rc=256} 10:51:10.251988 --- ParallelTerminationStrategy: PID 10233 died... 10:51:10.271892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10233): Terminated: ok {rc=0} 10:51:10.318878 --- ParallelTerminationStrategy: PID 10236 died... 10:51:10.339035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10236): Terminated: ok {rc=0} 10:51:10.385391 --- ParallelTerminationStrategy: PID 10239 died... 10:51:10.405170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10239): Terminated: ok {rc=0} 10:51:10.494054 bus /gobi_0: Setting Powered False 10:51:11.593089 bus /gobi_0: Setting Powered False 10:51:12.709840 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:51:13.859753 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:13.871937 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:51:13.942300 tst iperf3.py: using LAC 40417 10:51:14.070406 tst iperf3.py: using RAC 127 10:51:14.197760 tst iperf3.py: using CellId 40417 10:51:14.318212 tst iperf3.py: using BVCI 40418 10:51:14.430634 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:14.441948 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:14.453202 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:14.464442 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:14.475545 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:14.486794 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:14.498130 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:14.509177 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:14.520428 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:51:14.637472 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:51:14.842111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:15.149387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10241): Launched 10:51:15.417090 run iperf3-srv_10.42.42.10(pid=10242): Launched 10:51:15.532253 tst iperf3.py:8: start network... 10:51:15.736078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:16.223422 run create_hlr_db(pid=10243): Launched 10:51:16.416326 bus /gobi_6: Setting Powered False 10:51:17.476868 run create_hlr_db(pid=10243): Terminated: ok {rc=0} 10:51:17.929847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10245): Launched 10:51:18.257197 run osmo-hlr_10.42.42.2(pid=10246): Launched 10:51:18.382929 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:18.946979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10248): Launched 10:51:19.270865 run osmo-stp_10.42.42.5(pid=10249): Launched 10:51:19.395643 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:51:19.954838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10251): Launched 10:51:20.079806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:51:20.354708 run patchelf(pid=10252): Launched 10:51:20.537119 run osmo-stp_10.42.42.5(pid=10249): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10249)] 10:51:20.674181 run osmo-stp_10.42.42.5(pid=10249): stdout: | (launched: 2022-12-14_10:51:19.211120) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:20.812779 run osmo-stp_10.42.42.5(pid=10249): stderr: | 20221214105119401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105119401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105119402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105119402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105119403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105119403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105119403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:20.951351 run osmo-stp_10.42.42.5(pid=10249): stdout: | (launched: 2022-12-14_10:51:19.211120) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:21.083775 run osmo-stp_10.42.42.5(pid=10249): stderr: | 20221214105119401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105119401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105119402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105119402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105119403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105119403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105119403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:21.240157 run patchelf(pid=10252): Terminating (SIGINT) 10:51:21.422987 run patchelf(pid=10252): Terminated: ok {rc=0} 10:51:21.554520 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10249): Process ended prematurely: osmo-stp_10.42.42.5(pid=10249) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10249)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 10:51:21.564854 tst iperf3.py:8: Test FAILED (7.7 sec) 10:51:21.593949 run osmo-hlr_10.42.42.2(pid=10246): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10246)] 10:51:21.644454 run osmo-hlr_10.42.42.2(pid=10246): stdout: | (launched: 2022-12-14_10:51:18.197059) 10:51:21.696657 run osmo-hlr_10.42.42.2(pid=10246): stderr: | 20221214105118395 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105118395 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105118395 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105118395 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105118396 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105118396 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105118411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105118420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105118421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105118421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:21.749279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10241): Terminating (SIGTERM) 10:51:21.791173 run iperf3-srv_10.42.42.10(pid=10242): Terminating (SIGTERM) 10:51:21.833538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10245): Terminating (SIGTERM) 10:51:21.876586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10248): Terminating (SIGTERM) 10:51:21.918697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10251): Terminating (SIGTERM) 10:51:21.960839 --- ParallelTerminationStrategy: PID 10241 died... 10:51:21.981026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10241): Terminated: ok {rc=0} 10:51:22.027491 --- ParallelTerminationStrategy: PID 10242 died... 10:51:22.047146 run iperf3-srv_10.42.42.10(pid=10242): Terminated {rc=256} 10:51:22.093615 --- ParallelTerminationStrategy: PID 10245 died... 10:51:22.113291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10245): Terminated: ok {rc=0} 10:51:22.159576 --- ParallelTerminationStrategy: PID 10248 died... 10:51:22.179203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10248): Terminated: ok {rc=0} 10:51:22.225502 --- ParallelTerminationStrategy: PID 10251 died... 10:51:22.245252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10251): Terminated: ok {rc=0} 10:51:22.334511 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:51:23.485528 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:23.497718 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:51:23.565453 tst iperf3m4.py: using LAC 40418 10:51:23.692131 tst iperf3m4.py: using RAC 128 10:51:23.818597 tst iperf3m4.py: using CellId 40418 10:51:23.947613 tst iperf3m4.py: using BVCI 40419 10:51:24.066028 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:24.077651 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:24.088939 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:24.100424 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:24.111787 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:24.123191 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:24.134702 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:24.146168 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:24.157673 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:51:24.277248 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:51:24.401407 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:51:24.523317 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:51:24.642547 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:51:24.848744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:25.156215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10253): Launched 10:51:25.424789 run iperf3-srv_10.42.42.10(pid=10254): Launched 10:51:25.539805 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:51:25.744012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:26.051058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10255): Launched 10:51:26.320943 run iperf3-srv_10.42.42.10(pid=10256): Launched 10:51:26.435963 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:51:26.640304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:26.947048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10257): Launched 10:51:27.215993 run iperf3-srv_10.42.42.10(pid=10258): Launched 10:51:27.331044 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:51:27.535685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:27.843849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10259): Launched 10:51:28.111599 run iperf3-srv_10.42.42.10(pid=10260): Launched 10:51:28.226331 tst iperf3m4.py:8: start network... 10:51:28.430870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:28.902792 run create_hlr_db(pid=10261): Launched 10:51:29.020327 bus /gobi_6: Setting Powered False 10:51:30.081327 run create_hlr_db(pid=10261): Terminated: ok {rc=0} 10:51:30.508232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10263): Launched 10:51:30.817731 run osmo-hlr_10.42.42.2(pid=10264): Launched 10:51:31.098288 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:31.749101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10266): Launched 10:51:32.134105 run osmo-stp_10.42.42.5(pid=10267): Launched 10:51:32.313117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:51:32.892538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10269): Launched 10:51:33.012359 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:51:33.270914 run patchelf(pid=10270): Launched 10:51:33.443096 run osmo-stp_10.42.42.5(pid=10267): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10267)] 10:51:33.573103 run osmo-stp_10.42.42.5(pid=10267): stdout: | (launched: 2022-12-14_10:51:32.075722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:33.704387 run osmo-stp_10.42.42.5(pid=10267): stderr: | 20221214105132372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105132372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105132373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105132373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105132374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105132374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105132374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:33.835626 run osmo-stp_10.42.42.5(pid=10267): stdout: | (launched: 2022-12-14_10:51:32.075722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:33.961309 run osmo-stp_10.42.42.5(pid=10267): stderr: | 20221214105132372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105132372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105132373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105132373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105132374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105132374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105132374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:34.109548 run patchelf(pid=10270): Terminating (SIGINT) 10:51:34.280941 run patchelf(pid=10270): Terminated: ok {rc=0} 10:51:34.405323 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10267): Process ended prematurely: osmo-stp_10.42.42.5(pid=10267) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10267)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:51:34.415115 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:51:34.442644 run osmo-hlr_10.42.42.2(pid=10264): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10264)] 10:51:34.491015 run osmo-hlr_10.42.42.2(pid=10264): stdout: | (launched: 2022-12-14_10:51:30.757420) 10:51:34.540847 run osmo-hlr_10.42.42.2(pid=10264): stderr: | 20221214105131042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105131042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105131042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105131042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105131042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105131042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105131059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105131076 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105131076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105131076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:34.591149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10253): Terminating (SIGTERM) 10:51:34.631226 run iperf3-srv_10.42.42.10(pid=10254): Terminating (SIGTERM) 10:51:34.671251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10255): Terminating (SIGTERM) 10:51:34.711360 run iperf3-srv_10.42.42.10(pid=10256): Terminating (SIGTERM) 10:51:34.751203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10257): Terminating (SIGTERM) 10:51:34.791309 run iperf3-srv_10.42.42.10(pid=10258): Terminating (SIGTERM) 10:51:34.831667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10259): Terminating (SIGTERM) 10:51:34.872114 run iperf3-srv_10.42.42.10(pid=10260): Terminating (SIGTERM) 10:51:34.911910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10263): Terminating (SIGTERM) 10:51:34.951826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10266): Terminating (SIGTERM) 10:51:34.991577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10269): Terminating (SIGTERM) 10:51:35.031587 --- ParallelTerminationStrategy: PID 10253 died... 10:51:35.050951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10253): Terminated: ok {rc=0} 10:51:35.094981 --- ParallelTerminationStrategy: PID 10254 died... 10:51:35.113949 run iperf3-srv_10.42.42.10(pid=10254): Terminated {rc=256} 10:51:35.157658 --- ParallelTerminationStrategy: PID 10255 died... 10:51:35.176493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10255): Terminated: ok {rc=0} 10:51:35.220230 --- ParallelTerminationStrategy: PID 10256 died... 10:51:35.238980 run iperf3-srv_10.42.42.10(pid=10256): Terminated {rc=256} 10:51:35.282773 --- ParallelTerminationStrategy: PID 10257 died... 10:51:35.301505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10257): Terminated: ok {rc=0} 10:51:35.345259 --- ParallelTerminationStrategy: PID 10258 died... 10:51:35.363856 run iperf3-srv_10.42.42.10(pid=10258): Terminated {rc=256} 10:51:35.407659 --- ParallelTerminationStrategy: PID 10259 died... 10:51:35.426541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10259): Terminated: ok {rc=0} 10:51:35.470338 --- ParallelTerminationStrategy: PID 10260 died... 10:51:35.489119 run iperf3-srv_10.42.42.10(pid=10260): Terminated {rc=256} 10:51:35.533233 --- ParallelTerminationStrategy: PID 10263 died... 10:51:35.551965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10263): Terminated: ok {rc=0} 10:51:35.596177 --- ParallelTerminationStrategy: PID 10266 died... 10:51:35.614973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10266): Terminated: ok {rc=0} 10:51:35.658581 --- ParallelTerminationStrategy: PID 10269 died... 10:51:35.677539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10269): Terminated: ok {rc=0} 10:51:35.763784 bus /gobi_4: Setting Powered False 10:51:36.863385 bus /gobi_4: Setting Powered False 10:51:37.979323 bus /gobi_1: Setting Powered False 10:51:39.078628 bus /gobi_1: Setting Powered False 10:51:40.194124 bus /gobi_0: Setting Powered False 10:51:41.293576 bus /gobi_0: Setting Powered False 10:51:42.410566 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:51:43.513851 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:43.526031 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:51:43.595429 tst ping.py: using LAC 40419 10:51:43.722381 tst ping.py: using RAC 129 10:51:43.847193 tst ping.py: using CellId 40419 10:51:43.971722 tst ping.py: using BVCI 40420 10:51:44.087051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:44.098673 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:44.110114 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:44.121541 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:44.132854 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:44.144255 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:44.155703 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:44.167046 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:51:44.285529 tst ping.py:19: start network... 10:51:44.500402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:44.991586 run create_hlr_db(pid=10271): Launched 10:51:45.122437 bus /gobi_6: Setting Powered False 10:51:46.185868 run create_hlr_db(pid=10271): Terminated: ok {rc=0} 10:51:46.639049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10273): Launched 10:51:46.972090 run osmo-hlr_10.42.42.2(pid=10274): Launched 10:51:47.197079 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:47.751663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10276): Launched 10:51:48.072336 run osmo-stp_10.42.42.5(pid=10277): Launched 10:51:48.195238 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:51:48.746374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10279): Launched 10:51:48.870043 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:51:49.138416 run patchelf(pid=10280): Launched 10:51:49.316722 run osmo-stp_10.42.42.5(pid=10277): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10277)] 10:51:49.451817 run osmo-stp_10.42.42.5(pid=10277): stdout: | (launched: 2022-12-14_10:51:48.012719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:49.588171 run osmo-stp_10.42.42.5(pid=10277): stderr: | 20221214105148205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105148205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105148206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105148206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105148207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105148207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105148207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:49.724257 run osmo-stp_10.42.42.5(pid=10277): stdout: | (launched: 2022-12-14_10:51:48.012719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:49.854322 run osmo-stp_10.42.42.5(pid=10277): stderr: | 20221214105148205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105148205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105148206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105148206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105148207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105148207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105148207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:50.008242 run patchelf(pid=10280): Terminating (SIGINT) 10:51:50.186894 run patchelf(pid=10280): Terminated: ok {rc=0} 10:51:50.315627 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10277): Process ended prematurely: osmo-stp_10.42.42.5(pid=10277) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10277)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 10:51:50.325497 tst ping.py:22: Test FAILED (6.8 sec) 10:51:50.353673 run osmo-hlr_10.42.42.2(pid=10274): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10274)] 10:51:50.404393 run osmo-hlr_10.42.42.2(pid=10274): stdout: | (launched: 2022-12-14_10:51:46.913507) 10:51:50.456455 run osmo-hlr_10.42.42.2(pid=10274): stderr: | 20221214105147159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105147159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105147159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105147159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105147159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105147159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105147176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105147184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105147184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105147184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:50.508846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10273): Terminating (SIGTERM) 10:51:50.550998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10276): Terminating (SIGTERM) 10:51:50.592867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10279): Terminating (SIGTERM) 10:51:50.635091 --- ParallelTerminationStrategy: PID 10273 died... 10:51:50.655306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10273): Terminated: ok {rc=0} 10:51:50.701639 --- ParallelTerminationStrategy: PID 10276 died... 10:51:50.721255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10276): Terminated: ok {rc=0} 10:51:50.767214 --- ParallelTerminationStrategy: PID 10279 died... 10:51:50.786791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10279): Terminated: ok {rc=0} 10:51:50.874764 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:51:51.961092 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:51.973274 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:51:52.041759 tst ping_idle_ping.py: using LAC 40420 10:51:52.162944 tst ping_idle_ping.py: using RAC 130 10:51:52.282754 tst ping_idle_ping.py: using CellId 40420 10:51:52.401775 tst ping_idle_ping.py: using BVCI 40421 10:51:52.510310 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:52.521480 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:52.532526 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:52.543409 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:52.554625 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:52.566014 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:52.577253 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:51:52.588418 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:51:52.705678 tst ping_idle_ping.py:24: start network... 10:51:52.907191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:53.373911 run create_hlr_db(pid=10281): Launched 10:51:53.490743 bus /gobi_6: Setting Powered False 10:51:54.550984 run create_hlr_db(pid=10281): Terminated: ok {rc=0} 10:51:54.992922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10283): Launched 10:51:55.315529 run osmo-hlr_10.42.42.2(pid=10284): Launched 10:51:55.439667 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:55.997532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10286): Launched 10:51:56.318782 run osmo-stp_10.42.42.5(pid=10287): Launched 10:51:56.440859 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:51:56.992567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10289): Launched 10:51:57.116785 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:51:57.387575 run patchelf(pid=10290): Launched 10:51:57.566582 run osmo-stp_10.42.42.5(pid=10287): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10287)] 10:51:57.701981 run osmo-stp_10.42.42.5(pid=10287): stdout: | (launched: 2022-12-14_10:51:56.259301) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:57.839104 run osmo-stp_10.42.42.5(pid=10287): stderr: | 20221214105156450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105156450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105156451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105156451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105156452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105156452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105156452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:57.976031 run osmo-stp_10.42.42.5(pid=10287): stdout: | (launched: 2022-12-14_10:51:56.259301) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:58.107116 run osmo-stp_10.42.42.5(pid=10287): stderr: | 20221214105156450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105156450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105156451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105156451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105156452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105156452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105156452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:58.262038 run patchelf(pid=10290): Terminating (SIGINT) 10:51:58.442138 run patchelf(pid=10290): Terminated: ok {rc=0} 10:51:58.571099 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10287): Process ended prematurely: osmo-stp_10.42.42.5(pid=10287) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10287)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:51:58.580852 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:51:58.609287 run osmo-hlr_10.42.42.2(pid=10284): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10284)] 10:51:58.659116 run osmo-hlr_10.42.42.2(pid=10284): stdout: | (launched: 2022-12-14_10:51:55.256220) 10:51:58.711008 run osmo-hlr_10.42.42.2(pid=10284): stderr: | 20221214105155451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105155451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105155451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105155451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105155451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105155451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105155464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105155473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105155473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105155473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:58.763482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10283): Terminating (SIGTERM) 10:51:58.805447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10286): Terminating (SIGTERM) 10:51:58.847290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10289): Terminating (SIGTERM) 10:51:58.889498 --- ParallelTerminationStrategy: PID 10283 died... 10:51:58.909696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10283): Terminated: ok {rc=0} 10:51:58.955940 --- ParallelTerminationStrategy: PID 10286 died... 10:51:58.975559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10286): Terminated: ok {rc=0} 10:51:59.021676 --- ParallelTerminationStrategy: PID 10289 died... 10:51:59.041417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10289): Terminated: ok {rc=0} 10:51:59.128872 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:52:00.434998 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:52:00.441636 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:52:00.471336 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:52:00.511701 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:52:00.598591 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:52:00.627242 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:52:00.665273 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:52:01.293984 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:52:01.361937 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:01.377387 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:52:01.448803 tst cs_paging_gprs_active.py: using LAC 40421 10:52:01.582567 tst cs_paging_gprs_active.py: using RAC 131 10:52:01.716397 tst cs_paging_gprs_active.py: using CellId 40421 10:52:01.847616 tst cs_paging_gprs_active.py: using BVCI 40422 10:52:01.996373 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:02.008781 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:02.020318 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:02.031804 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:02.043683 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:02.055460 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:02.067348 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:02.079417 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:02.091344 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:52:02.212154 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:52:02.332049 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:52:02.537995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:02.846767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10295): Launched 10:52:03.115958 run iperf3-srv_10.42.42.10(pid=10296): Launched 10:52:03.231393 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:52:03.437242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:03.746887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10297): Launched 10:52:04.015884 run iperf3-srv_10.42.42.10(pid=10298): Launched 10:52:04.131117 tst cs_paging_gprs_active.py:38: start network... 10:52:04.337105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:04.813416 run create_hlr_db(pid=10299): Launched 10:52:04.930399 bus /gobi_6: Setting Powered False 10:52:05.991292 run create_hlr_db(pid=10299): Terminated: ok {rc=0} 10:52:06.419815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10301): Launched 10:52:06.729361 run osmo-hlr_10.42.42.2(pid=10302): Launched 10:52:06.847328 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:07.382483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10304): Launched 10:52:07.692046 run osmo-stp_10.42.42.5(pid=10305): Launched 10:52:07.809192 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:52:08.339451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10307): Launched 10:52:08.458860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:52:08.726826 run patchelf(pid=10308): Launched 10:52:08.898973 run osmo-stp_10.42.42.5(pid=10305): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10305)] 10:52:09.030325 run osmo-stp_10.42.42.5(pid=10305): stdout: | (launched: 2022-12-14_10:52:07.635068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:09.162843 run osmo-stp_10.42.42.5(pid=10305): stderr: | 20221214105207803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105207804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105207804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105207804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105207805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105207805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105207805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:09.294831 run osmo-stp_10.42.42.5(pid=10305): stdout: | (launched: 2022-12-14_10:52:07.635068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:09.421097 run osmo-stp_10.42.42.5(pid=10305): stderr: | 20221214105207803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105207804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105207804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105207804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105207805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105207805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105207805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:09.570359 run patchelf(pid=10308): Terminating (SIGINT) 10:52:09.744246 run patchelf(pid=10308): Terminated: ok {rc=0} 10:52:09.869392 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10305): Process ended prematurely: osmo-stp_10.42.42.5(pid=10305) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10305)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:52:09.879080 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:52:09.906612 run osmo-hlr_10.42.42.2(pid=10302): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10302)] 10:52:09.955053 run osmo-hlr_10.42.42.2(pid=10302): stdout: | (launched: 2022-12-14_10:52:06.672073) 10:52:10.005116 run osmo-hlr_10.42.42.2(pid=10302): stderr: | 20221214105206848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105206848 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105206848 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105206848 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105206848 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105206848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105206864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105206874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105206874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105206874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:10.055288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10295): Terminating (SIGTERM) 10:52:10.095756 run iperf3-srv_10.42.42.10(pid=10296): Terminating (SIGTERM) 10:52:10.136280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10297): Terminating (SIGTERM) 10:52:10.176885 run iperf3-srv_10.42.42.10(pid=10298): Terminating (SIGTERM) 10:52:10.217278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10301): Terminating (SIGTERM) 10:52:10.257954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10304): Terminating (SIGTERM) 10:52:10.298280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10307): Terminating (SIGTERM) 10:52:10.338982 --- ParallelTerminationStrategy: PID 10295 died... 10:52:10.358766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10295): Terminated: ok {rc=0} 10:52:10.403282 --- ParallelTerminationStrategy: PID 10296 died... 10:52:10.422375 run iperf3-srv_10.42.42.10(pid=10296): Terminated {rc=256} 10:52:10.466664 --- ParallelTerminationStrategy: PID 10297 died... 10:52:10.485809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10297): Terminated: ok {rc=0} 10:52:10.530042 --- ParallelTerminationStrategy: PID 10298 died... 10:52:10.549157 run iperf3-srv_10.42.42.10(pid=10298): Terminated {rc=256} 10:52:10.593925 --- ParallelTerminationStrategy: PID 10301 died... 10:52:10.613044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10301): Terminated: ok {rc=0} 10:52:10.657391 --- ParallelTerminationStrategy: PID 10304 died... 10:52:10.676536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10304): Terminated: ok {rc=0} 10:52:10.720711 --- ParallelTerminationStrategy: PID 10307 died... 10:52:10.740330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10307): Terminated: ok {rc=0} 10:52:10.827936 bus /gobi_0: Setting Powered False 10:52:11.928350 bus /gobi_0: Setting Powered False 10:52:13.044422 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:52:14.192371 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:14.204386 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:52:14.271042 tst iperf3.py: using LAC 40422 10:52:14.390364 tst iperf3.py: using RAC 132 10:52:14.511299 tst iperf3.py: using CellId 40422 10:52:14.633512 tst iperf3.py: using BVCI 40423 10:52:14.752351 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:14.764140 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:14.775718 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:14.787250 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:14.798802 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:14.810289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:14.821778 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:14.832923 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:14.844352 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:52:14.962263 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:52:15.167640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:15.475739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10309): Launched 10:52:15.743893 run iperf3-srv_10.42.42.10(pid=10310): Launched 10:52:15.877965 tst iperf3.py:8: start network... 10:52:16.087154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:16.574493 run create_hlr_db(pid=10311): Launched 10:52:16.730380 bus /gobi_6: Setting Powered False 10:52:17.791720 run create_hlr_db(pid=10311): Terminated: ok {rc=0} 10:52:18.238922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10313): Launched 10:52:18.566213 run osmo-hlr_10.42.42.2(pid=10314): Launched 10:52:18.691326 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:19.260129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10316): Launched 10:52:19.586872 run osmo-stp_10.42.42.5(pid=10317): Launched 10:52:19.711143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:52:20.271541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10319): Launched 10:52:20.398670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:52:20.674637 run patchelf(pid=10320): Launched 10:52:20.855743 run osmo-stp_10.42.42.5(pid=10317): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10317)] 10:52:20.993394 run osmo-stp_10.42.42.5(pid=10317): stdout: | (launched: 2022-12-14_10:52:19.526699) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:21.132324 run osmo-stp_10.42.42.5(pid=10317): stderr: | 20221214105219717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105219717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105219717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105219718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105219718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105219718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105219718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:21.271445 run osmo-stp_10.42.42.5(pid=10317): stdout: | (launched: 2022-12-14_10:52:19.526699) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:21.404486 run osmo-stp_10.42.42.5(pid=10317): stderr: | 20221214105219717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105219717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105219717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105219718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105219718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105219718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105219718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:21.562078 run patchelf(pid=10320): Terminating (SIGINT) 10:52:21.744774 run patchelf(pid=10320): Terminated: ok {rc=0} 10:52:21.876524 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10317): Process ended prematurely: osmo-stp_10.42.42.5(pid=10317) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10317)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 10:52:21.887026 tst iperf3.py:8: Test FAILED (7.7 sec) 10:52:21.915807 run osmo-hlr_10.42.42.2(pid=10314): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10314)] 10:52:21.966048 run osmo-hlr_10.42.42.2(pid=10314): stdout: | (launched: 2022-12-14_10:52:18.505961) 10:52:22.018228 run osmo-hlr_10.42.42.2(pid=10314): stderr: | 20221214105218704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105218704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105218704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105218704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105218704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105218704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105218719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105218729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105218730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105218730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:22.070898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10309): Terminating (SIGTERM) 10:52:22.113199 run iperf3-srv_10.42.42.10(pid=10310): Terminating (SIGTERM) 10:52:22.155356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10313): Terminating (SIGTERM) 10:52:22.197378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10316): Terminating (SIGTERM) 10:52:22.239206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10319): Terminating (SIGTERM) 10:52:22.281455 --- ParallelTerminationStrategy: PID 10309 died... 10:52:22.301865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10309): Terminated: ok {rc=0} 10:52:22.348377 --- ParallelTerminationStrategy: PID 10310 died... 10:52:22.368424 run iperf3-srv_10.42.42.10(pid=10310): Terminated {rc=256} 10:52:22.415000 --- ParallelTerminationStrategy: PID 10313 died... 10:52:22.434795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10313): Terminated: ok {rc=0} 10:52:22.481110 --- ParallelTerminationStrategy: PID 10316 died... 10:52:22.500758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10316): Terminated: ok {rc=0} 10:52:22.547230 --- ParallelTerminationStrategy: PID 10319 died... 10:52:22.566921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10319): Terminated: ok {rc=0} 10:52:22.655423 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:52:23.799782 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:23.811563 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:52:23.878670 tst iperf3m4.py: using LAC 40423 10:52:23.996739 tst iperf3m4.py: using RAC 133 10:52:24.115444 tst iperf3m4.py: using CellId 40423 10:52:24.237860 tst iperf3m4.py: using BVCI 40424 10:52:24.350173 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:24.361309 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:24.372560 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:24.383435 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:24.394641 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:24.405854 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:24.417137 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:24.428113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:24.439861 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:52:24.562243 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:52:24.683340 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:52:24.805502 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:52:24.923898 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:52:25.144151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:25.472078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10321): Launched 10:52:25.757741 run iperf3-srv_10.42.42.10(pid=10322): Launched 10:52:25.879599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:52:26.098097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:26.426289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10323): Launched 10:52:26.710801 run iperf3-srv_10.42.42.10(pid=10324): Launched 10:52:26.834174 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:52:27.052678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:27.380361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10325): Launched 10:52:27.665370 run iperf3-srv_10.42.42.10(pid=10326): Launched 10:52:27.787533 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:52:28.006744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:28.328901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10327): Launched 10:52:28.599888 run iperf3-srv_10.42.42.10(pid=10328): Launched 10:52:28.715152 tst iperf3m4.py:8: start network... 10:52:28.919831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:29.395745 run create_hlr_db(pid=10329): Launched 10:52:29.512215 bus /gobi_6: Setting Powered False 10:52:30.573692 run create_hlr_db(pid=10329): Terminated: ok {rc=0} 10:52:31.045766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10331): Launched 10:52:31.390809 run osmo-hlr_10.42.42.2(pid=10332): Launched 10:52:31.663446 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:32.331716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10334): Launched 10:52:32.641154 run osmo-stp_10.42.42.5(pid=10335): Launched 10:52:32.758015 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:52:33.286844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10337): Launched 10:52:33.406409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:52:33.666332 run patchelf(pid=10338): Launched 10:52:33.839799 run osmo-stp_10.42.42.5(pid=10335): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10335)] 10:52:33.969564 run osmo-stp_10.42.42.5(pid=10335): stdout: | (launched: 2022-12-14_10:52:32.583946) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:34.101393 run osmo-stp_10.42.42.5(pid=10335): stderr: | 20221214105232755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105232755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105232755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105232756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105232756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105232756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105232756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:34.232471 run osmo-stp_10.42.42.5(pid=10335): stdout: | (launched: 2022-12-14_10:52:32.583946) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:34.358010 run osmo-stp_10.42.42.5(pid=10335): stderr: | 20221214105232755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105232755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105232755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105232756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105232756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105232756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105232756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:34.506563 run patchelf(pid=10338): Terminating (SIGINT) 10:52:34.678732 run patchelf(pid=10338): Terminated: ok {rc=0} 10:52:34.803548 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10335): Process ended prematurely: osmo-stp_10.42.42.5(pid=10335) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10335)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:52:34.813433 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:52:34.841250 run osmo-hlr_10.42.42.2(pid=10332): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10332)] 10:52:34.890180 run osmo-hlr_10.42.42.2(pid=10332): stdout: | (launched: 2022-12-14_10:52:31.328685) 10:52:34.940505 run osmo-hlr_10.42.42.2(pid=10332): stderr: | 20221214105231600 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105231600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105231600 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105231600 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105231601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105231601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105231620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105231639 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105231639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105231639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:34.991264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10321): Terminating (SIGTERM) 10:52:35.032288 run iperf3-srv_10.42.42.10(pid=10322): Terminating (SIGTERM) 10:52:35.073033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10323): Terminating (SIGTERM) 10:52:35.113809 run iperf3-srv_10.42.42.10(pid=10324): Terminating (SIGTERM) 10:52:35.154503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10325): Terminating (SIGTERM) 10:52:35.195203 run iperf3-srv_10.42.42.10(pid=10326): Terminating (SIGTERM) 10:52:35.235792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10327): Terminating (SIGTERM) 10:52:35.276563 run iperf3-srv_10.42.42.10(pid=10328): Terminating (SIGTERM) 10:52:35.317195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10331): Terminating (SIGTERM) 10:52:35.358341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10334): Terminating (SIGTERM) 10:52:35.399084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10337): Terminating (SIGTERM) 10:52:35.439973 --- ParallelTerminationStrategy: PID 10321 died... 10:52:35.460124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10321): Terminated: ok {rc=0} 10:52:35.505210 --- ParallelTerminationStrategy: PID 10322 died... 10:52:35.524321 run iperf3-srv_10.42.42.10(pid=10322): Terminated {rc=256} 10:52:35.569106 --- ParallelTerminationStrategy: PID 10323 died... 10:52:35.588206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10323): Terminated: ok {rc=0} 10:52:35.633272 --- ParallelTerminationStrategy: PID 10324 died... 10:52:35.652274 run iperf3-srv_10.42.42.10(pid=10324): Terminated {rc=256} 10:52:35.696779 --- ParallelTerminationStrategy: PID 10325 died... 10:52:35.715988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10325): Terminated: ok {rc=0} 10:52:35.760389 --- ParallelTerminationStrategy: PID 10326 died... 10:52:35.779761 run iperf3-srv_10.42.42.10(pid=10326): Terminated {rc=256} 10:52:35.824347 --- ParallelTerminationStrategy: PID 10327 died... 10:52:35.843673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10327): Terminated: ok {rc=0} 10:52:35.888340 --- ParallelTerminationStrategy: PID 10328 died... 10:52:35.907503 run iperf3-srv_10.42.42.10(pid=10328): Terminated {rc=256} 10:52:35.951798 --- ParallelTerminationStrategy: PID 10331 died... 10:52:35.971096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10331): Terminated: ok {rc=0} 10:52:36.015602 --- ParallelTerminationStrategy: PID 10334 died... 10:52:36.034658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10334): Terminated: ok {rc=0} 10:52:36.079041 --- ParallelTerminationStrategy: PID 10337 died... 10:52:36.098450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10337): Terminated: ok {rc=0} 10:52:36.185370 bus /gobi_4: Setting Powered False 10:52:37.288431 bus /gobi_4: Setting Powered False 10:52:38.405938 bus /gobi_1: Setting Powered False 10:52:39.504165 bus /gobi_1: Setting Powered False 10:52:40.622399 bus /gobi_0: Setting Powered False 10:52:41.723019 bus /gobi_0: Setting Powered False 10:52:42.841240 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:52:43.944146 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:43.956422 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:52:44.028745 tst ping.py: using LAC 40424 10:52:44.152694 tst ping.py: using RAC 134 10:52:44.277170 tst ping.py: using CellId 40424 10:52:44.400517 tst ping.py: using BVCI 40425 10:52:44.518832 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:44.530544 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:44.541957 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:44.553378 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:44.564691 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:44.576144 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:44.587597 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:44.598974 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:52:44.715429 tst ping.py:19: start network... 10:52:44.917480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:45.383288 run create_hlr_db(pid=10339): Launched 10:52:45.498805 bus /gobi_6: Setting Powered False 10:52:46.558105 run create_hlr_db(pid=10339): Terminated: ok {rc=0} 10:52:46.989591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10341): Launched 10:52:47.307887 run osmo-hlr_10.42.42.2(pid=10342): Launched 10:52:47.424684 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:47.958054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10344): Launched 10:52:48.262571 run osmo-stp_10.42.42.5(pid=10345): Launched 10:52:48.380598 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:52:48.902105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10347): Launched 10:52:49.018065 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:52:49.273501 run patchelf(pid=10348): Launched 10:52:49.442305 run osmo-stp_10.42.42.5(pid=10345): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10345)] 10:52:49.570706 run osmo-stp_10.42.42.5(pid=10345): stdout: | (launched: 2022-12-14_10:52:48.206052) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:49.700696 run osmo-stp_10.42.42.5(pid=10345): stderr: | 20221214105248376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105248376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105248376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105248377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105248377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105248377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105248377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:49.830390 run osmo-stp_10.42.42.5(pid=10345): stdout: | (launched: 2022-12-14_10:52:48.206052) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:49.953674 run osmo-stp_10.42.42.5(pid=10345): stderr: | 20221214105248376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105248376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105248376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105248377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105248377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105248377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105248377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:50.099842 run patchelf(pid=10348): Terminating (SIGINT) 10:52:50.269437 run patchelf(pid=10348): Terminated: ok {rc=0} 10:52:50.391793 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10345): Process ended prematurely: osmo-stp_10.42.42.5(pid=10345) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10345)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 10:52:50.400836 tst ping.py:22: Test FAILED (6.4 sec) 10:52:50.427953 run osmo-hlr_10.42.42.2(pid=10342): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10342)] 10:52:50.476219 run osmo-hlr_10.42.42.2(pid=10342): stdout: | (launched: 2022-12-14_10:52:47.251923) 10:52:50.526309 run osmo-hlr_10.42.42.2(pid=10342): stderr: | 20221214105247426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105247426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105247426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105247426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105247426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105247426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105247438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105247446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105247446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105247446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:50.577326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10341): Terminating (SIGTERM) 10:52:50.617338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10344): Terminating (SIGTERM) 10:52:50.657449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10347): Terminating (SIGTERM) 10:52:50.697706 --- ParallelTerminationStrategy: PID 10341 died... 10:52:50.717679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10341): Terminated: ok {rc=0} 10:52:50.762159 --- ParallelTerminationStrategy: PID 10344 died... 10:52:50.781134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10344): Terminated: ok {rc=0} 10:52:50.825520 --- ParallelTerminationStrategy: PID 10347 died... 10:52:50.844532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10347): Terminated: ok {rc=0} 10:52:50.931424 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:52:52.019398 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:52.031297 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:52:52.099534 tst ping_idle_ping.py: using LAC 40425 10:52:52.217370 tst ping_idle_ping.py: using RAC 135 10:52:52.336215 tst ping_idle_ping.py: using CellId 40425 10:52:52.453798 tst ping_idle_ping.py: using BVCI 40426 10:52:52.563065 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:52.574541 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:52.585835 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:52.596869 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:52.608679 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:52.620122 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:52.631652 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:52:52.643019 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:52:52.763448 tst ping_idle_ping.py:24: start network... 10:52:52.980364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:53.481596 run create_hlr_db(pid=10349): Launched 10:52:53.614200 bus /gobi_6: Setting Powered False 10:52:54.678961 run create_hlr_db(pid=10349): Terminated: ok {rc=0} 10:52:55.111397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10351): Launched 10:52:55.414037 run osmo-hlr_10.42.42.2(pid=10352): Launched 10:52:55.529921 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:56.061563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10354): Launched 10:52:56.364324 run osmo-stp_10.42.42.5(pid=10355): Launched 10:52:56.480328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:52:57.003736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10357): Launched 10:52:57.122489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:52:57.379104 run patchelf(pid=10358): Launched 10:52:57.549893 run osmo-stp_10.42.42.5(pid=10355): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10355)] 10:52:57.678530 run osmo-stp_10.42.42.5(pid=10355): stdout: | (launched: 2022-12-14_10:52:56.308095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:57.808730 run osmo-stp_10.42.42.5(pid=10355): stderr: | 20221214105256476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105256476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105256477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105256477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105256478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105256478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105256478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:57.939179 run osmo-stp_10.42.42.5(pid=10355): stdout: | (launched: 2022-12-14_10:52:56.308095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:58.063145 run osmo-stp_10.42.42.5(pid=10355): stderr: | 20221214105256476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105256476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105256477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105256477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105256478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105256478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105256478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:58.210130 run patchelf(pid=10358): Terminating (SIGINT) 10:52:58.379761 run patchelf(pid=10358): Terminated: ok {rc=0} 10:52:58.502570 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10355): Process ended prematurely: osmo-stp_10.42.42.5(pid=10355) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10355)] [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:52:58.511776 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:52:58.538995 run osmo-hlr_10.42.42.2(pid=10352): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10352)] 10:52:58.587378 run osmo-hlr_10.42.42.2(pid=10352): stdout: | (launched: 2022-12-14_10:52:55.357749) 10:52:58.637956 run osmo-hlr_10.42.42.2(pid=10352): stderr: | 20221214105255532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105255532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105255532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105255532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105255532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105255533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105255547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105255555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105255555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105255555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:58.688547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10351): Terminating (SIGTERM) 10:52:58.728918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10354): Terminating (SIGTERM) 10:52:58.769388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10357): Terminating (SIGTERM) 10:52:58.809970 --- ParallelTerminationStrategy: PID 10351 died... 10:52:58.829909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10351): Terminated: ok {rc=0} 10:52:58.874545 --- ParallelTerminationStrategy: PID 10354 died... 10:52:58.893788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10354): Terminated: ok {rc=0} 10:52:58.938246 --- ParallelTerminationStrategy: PID 10357 died... 10:52:58.957296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10357): Terminated: ok {rc=0} 10:52:59.041629 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:53:00.343905 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:00.352554 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:53:00.382833 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:53:00.419243 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:53:00.473229 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:53:00.503214 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:53:00.538992 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:53:01.139861 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:53:01.146786 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:53:01.159165 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:53:01.229495 tst switch_tch_pdch.py: using LAC 40426 10:53:01.382270 tst switch_tch_pdch.py: using RAC 136 10:53:01.513537 tst switch_tch_pdch.py: using CellId 40426 10:53:01.635188 tst switch_tch_pdch.py: using BVCI 40427 10:53:01.751780 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:53:01.764223 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:53:01.776609 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:53:01.789100 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:53:01.802808 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:53:01.816176 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:53:01.829785 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:53:01.844198 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:53:01.968336 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:53:02.108828 tst switch_tch_pdch.py:51: start network... 10:53:02.342024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:02.836715 run create_hlr_db(pid=10363): Launched 10:53:02.967176 bus /gobi_6: Setting Powered False 10:53:04.031207 run create_hlr_db(pid=10363): Terminated: ok {rc=0} 10:53:04.479581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10365): Launched 10:53:04.801396 run osmo-hlr_10.42.42.2(pid=10366): Launched 10:53:04.924396 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:05.480675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10368): Launched 10:53:05.802415 run osmo-stp_10.42.42.5(pid=10369): Launched 10:53:05.925501 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:53:06.479376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10371): Launched 10:53:06.603430 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:53:06.874902 run patchelf(pid=10372): Launched 10:53:07.054705 run osmo-stp_10.42.42.5(pid=10369): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10369)] 10:53:07.190223 run osmo-stp_10.42.42.5(pid=10369): stdout: | (launched: 2022-12-14_10:53:05.743078) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:07.327356 run osmo-stp_10.42.42.5(pid=10369): stderr: | 20221214105305934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105305934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105305934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105305934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105305935 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105305935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105305935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:07.465252 run osmo-stp_10.42.42.5(pid=10369): stdout: | (launched: 2022-12-14_10:53:05.743078) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:07.596015 run osmo-stp_10.42.42.5(pid=10369): stderr: | 20221214105305934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105305934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105305934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105305934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105305935 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105305935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105305935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:07.751394 run patchelf(pid=10372): Terminating (SIGINT) 10:53:07.930803 run patchelf(pid=10372): Terminated: ok {rc=0} 10:53:08.060406 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10369): Process ended prematurely: osmo-stp_10.42.42.5(pid=10369) [trial-2403↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10369)] [trial-2403↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:53:08.070406 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 10:53:08.098842 run osmo-hlr_10.42.42.2(pid=10366): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10366)] 10:53:08.149264 run osmo-hlr_10.42.42.2(pid=10366): stdout: | (launched: 2022-12-14_10:53:04.742204) 10:53:08.201552 run osmo-hlr_10.42.42.2(pid=10366): stderr: | 20221214105304940 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105304940 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105304940 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105304940 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105304940 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105304940 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105304951 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105304959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105304959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105304959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:08.254224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10365): Terminating (SIGTERM) 10:53:08.296449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10368): Terminating (SIGTERM) 10:53:08.339027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10371): Terminating (SIGTERM) 10:53:08.381219 --- ParallelTerminationStrategy: PID 10365 died... 10:53:08.401875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10365): Terminated: ok {rc=0} 10:53:08.448352 --- ParallelTerminationStrategy: PID 10368 died... 10:53:08.468236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10368): Terminated: ok {rc=0} 10:53:08.514389 --- ParallelTerminationStrategy: PID 10371 died... 10:53:08.534050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10371): Terminated: ok {rc=0} 10:53:08.622450 bus /gobi_0: Setting Powered False 10:53:09.721993 bus /gobi_0: Setting Powered False 10:53:10.838414 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:53:12.097869 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:12.104180 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:53:12.133882 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:53:12.169319 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:53:12.223183 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:53:12.252713 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:53:12.287572 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:53:12.841821 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:53:12.847122 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:53:12.858448 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:53:12.928622 tst switch_tch_pdch.py: using LAC 40427 10:53:13.045943 tst switch_tch_pdch.py: using RAC 137 10:53:13.163633 tst switch_tch_pdch.py: using CellId 40427 10:53:13.278953 tst switch_tch_pdch.py: using BVCI 40428 10:53:13.387119 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:53:13.398229 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:53:13.409366 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:53:13.420420 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:53:13.431564 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:53:13.442826 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:53:13.454183 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:53:13.465438 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:53:13.584480 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:53:13.702233 tst switch_tch_pdch.py:51: start network... 10:53:13.903166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:14.343415 run create_hlr_db(pid=10376): Launched 10:53:14.458508 bus /gobi_6: Setting Powered False 10:53:15.519149 run create_hlr_db(pid=10376): Terminated: ok {rc=0} 10:53:15.947361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10378): Launched 10:53:16.285073 run osmo-hlr_10.42.42.2(pid=10379): Launched 10:53:16.492793 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:17.058045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10381): Launched 10:53:17.393497 run osmo-stp_10.42.42.5(pid=10382): Launched 10:53:17.519126 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:53:18.045534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10384): Launched 10:53:18.169696 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:53:18.440549 run patchelf(pid=10385): Launched 10:53:18.619275 run osmo-stp_10.42.42.5(pid=10382): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10382)] 10:53:18.754766 run osmo-stp_10.42.42.5(pid=10382): stdout: | (launched: 2022-12-14_10:53:17.334677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:18.893112 run osmo-stp_10.42.42.5(pid=10382): stderr: | 20221214105317525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105317525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105317525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105317526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105317526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105317526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105317526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:19.030696 run osmo-stp_10.42.42.5(pid=10382): stdout: | (launched: 2022-12-14_10:53:17.334677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:19.161530 run osmo-stp_10.42.42.5(pid=10382): stderr: | 20221214105317525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105317525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105317525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105317526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105317526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105317526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105317526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:19.316841 run patchelf(pid=10385): Terminating (SIGINT) 10:53:19.496436 run patchelf(pid=10385): Terminated: ok {rc=0} 10:53:19.626069 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10382): Process ended prematurely: osmo-stp_10.42.42.5(pid=10382) [trial-2403↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10382)] [trial-2403↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:53:19.635912 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 10:53:19.664430 run osmo-hlr_10.42.42.2(pid=10379): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10379)] 10:53:19.714958 run osmo-hlr_10.42.42.2(pid=10379): stdout: | (launched: 2022-12-14_10:53:16.223172) 10:53:19.767670 run osmo-hlr_10.42.42.2(pid=10379): stderr: | 20221214105316413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105316413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105316413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105316413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105316413 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105316413 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105316431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105316451 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105316451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105316451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:19.820690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10378): Terminating (SIGTERM) 10:53:19.863187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10381): Terminating (SIGTERM) 10:53:19.906147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10384): Terminating (SIGTERM) 10:53:19.948906 --- ParallelTerminationStrategy: PID 10378 died... 10:53:19.969311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10378): Terminated: ok {rc=0} 10:53:20.016063 --- ParallelTerminationStrategy: PID 10381 died... 10:53:20.035985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10381): Terminated: ok {rc=0} 10:53:20.082529 --- ParallelTerminationStrategy: PID 10384 died... 10:53:20.102291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10384): Terminated: ok {rc=0} 10:53:20.191022 bus /gobi_0: Setting Powered False 10:53:21.291278 bus /gobi_0: Setting Powered False 10:53:22.410939 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_sms:nanobts --------------------------------------------------------------------- 10:53:23.657881 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:23.662798 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 10:53:23.687553 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 10:53:23.694568 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 10:53:23.748563 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 10:53:23.772897 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 10:53:23.779869 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 10:53:24.318548 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 10:53:24.324135 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 10:53:24.335347 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 10:53:24.374285 tst mo_mt_sms.py: using LAC 40428 10:53:24.499734 tst mo_mt_sms.py: using RAC 138 10:53:24.624577 tst mo_mt_sms.py: using CellId 40428 10:53:24.750891 tst mo_mt_sms.py: using BVCI 40429 10:53:24.868023 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 10:53:24.985326 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 10:53:25.102198 tst mo_mt_sms.py:9: start nitb and bts... 10:53:25.317189 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:53:25.970486 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10389): Launched 10:53:26.293337 run osmo-nitb_10.42.42.2(pid=10390): Launched 10:53:26.474224 run osmo-nitb_10.42.42.2(pid=10390): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10390)] 10:53:26.618759 run osmo-nitb_10.42.42.2(pid=10390): stdout: | (launched: 2022-12-14_10:53:26.234222) 10:53:26.764329 run osmo-nitb_10.42.42.2(pid=10390): stderr: | (launched: 2022-12-14_10:53:26.281748) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:53:26.910786 run osmo-nitb_10.42.42.2(pid=10390): stdout: | (launched: 2022-12-14_10:53:26.234222) 10:53:27.051109 run osmo-nitb_10.42.42.2(pid=10390): stderr: | (launched: 2022-12-14_10:53:26.281748) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10390): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10390) [trial-2403↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10390)] 10:53:27.416556 tst osmo-nitb_10.42.42.2(pid=10390): stdout: | (launched: 2022-12-14_10:53:26.234222) 10:53:27.547332 tst osmo-nitb_10.42.42.2(pid=10390): stderr: | (launched: 2022-12-14_10:53:26.281748) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:53:27.700460 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=10390): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10390) [trial-2403↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10390)] [trial-2403↪nitb_sms:nanobts↪mo_mt_sms.py:11] 10:53:27.709796 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 10:53:27.716821 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10389): Terminating (SIGTERM) 10:53:27.927930 --- ParallelTerminationStrategy: PID 10389 died... 10:53:27.949882 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10389): Terminated: ok {rc=0} 10:53:28.039345 bus /sierra_3: Setting Powered False 10:53:29.140635 bus /sierra_3: Setting Powered False 10:53:30.258916 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 sms:nanobts+band-1900 --------------------------------------------------------------------- 10:53:31.468280 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:31.475213 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:53:31.508415 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 10:53:31.544883 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 10:53:31.607418 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:53:31.642414 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 10:53:31.677611 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 10:53:32.211525 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 10:53:32.217230 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:32.229093 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:53:32.266866 tst mo_mt_sms.py: using LAC 40429 10:53:32.392917 tst mo_mt_sms.py: using RAC 139 10:53:32.518301 tst mo_mt_sms.py: using CellId 40429 10:53:32.644888 tst mo_mt_sms.py: using BVCI 40430 10:53:32.759823 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:32.770938 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:32.782029 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:32.792926 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:32.804024 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:32.814950 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 10:53:32.934119 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 10:53:33.055564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:33.551360 run create_hlr_db(pid=10394): Launched 10:53:33.681287 bus /sierra_2: Setting Powered False 10:53:34.744663 run create_hlr_db(pid=10394): Terminated: ok {rc=0} 10:53:35.174576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10396): Launched 10:53:35.477993 run osmo-hlr_10.42.42.2(pid=10397): Launched 10:53:35.594913 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:36.125631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10399): Launched 10:53:36.427478 run osmo-stp_10.42.42.5(pid=10400): Launched 10:53:36.544747 run osmo-msc_10.42.42.6: Starting osmo-msc 10:53:37.090337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10402): Launched 10:53:37.394404 run osmo-msc_10.42.42.6(pid=10403): Launched 10:53:37.565340 run osmo-stp_10.42.42.5(pid=10400): ERR: Terminated: ERROR {rc=1} [trial-2403↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10400)] 10:53:37.693831 run osmo-stp_10.42.42.5(pid=10400): stdout: | (launched: 2022-12-14_10:53:36.371320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:37.822028 run osmo-stp_10.42.42.5(pid=10400): stderr: | 20221214105336542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105336542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105336542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105336543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105336543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105336543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105336543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:37.947548 run osmo-stp_10.42.42.5(pid=10400): stdout: | (launched: 2022-12-14_10:53:36.371320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:38.067654 run osmo-stp_10.42.42.5(pid=10400): stderr: | 20221214105336542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105336542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105336542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105336543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105336543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105336543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105336543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:38.211760 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10400): Process ended prematurely: osmo-stp_10.42.42.5(pid=10400) [trial-2403↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10400)] [trial-2403↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 10:53:38.220484 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 10:53:38.246647 run osmo-hlr_10.42.42.2(pid=10397): ERR: Terminated: ERROR {rc=237} [trial-2403↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10397)] 10:53:38.295430 run osmo-hlr_10.42.42.2(pid=10397): stdout: | (launched: 2022-12-14_10:53:35.421810) 10:53:38.345480 run osmo-hlr_10.42.42.2(pid=10397): stderr: | 20221214105335597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105335597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105335597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105335597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105335597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105335597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105335610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105335619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105335619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105335619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:38.415608 run osmo-msc_10.42.42.6(pid=10403): ERR: Terminated: ERROR {rc=2} [trial-2403↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10403)] 10:53:38.463734 run osmo-msc_10.42.42.6(pid=10403): stdout: | (launched: 2022-12-14_10:53:37.338327) 10:53:38.513577 run osmo-msc_10.42.42.6(pid=10403): stderr: | 20221214105337607 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105337607 DLGLOBAL DEBUG validating counter group 0x7fb4920d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105337607 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105337607 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105337608 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105337608 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105337610 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105337610 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105337610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105337610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:53:38.563888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10396): Terminating (SIGTERM) 10:53:38.604743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10399): Terminating (SIGTERM) 10:53:38.645326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10402): Terminating (SIGTERM) 10:53:38.686638 --- ParallelTerminationStrategy: PID 10396 died... 10:53:38.706759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10396): Terminated: ok {rc=0} 10:53:38.751392 --- ParallelTerminationStrategy: PID 10399 died... 10:53:38.770531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10399): Terminated: ok {rc=0} 10:53:38.814839 --- ParallelTerminationStrategy: PID 10402 died... 10:53:38.834174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10402): Terminated: ok {rc=0} 10:53:38.920889 bus /sierra_3: Setting Powered False 10:53:40.023445 bus /sierra_3: Setting Powered False 10:53:41.140862 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 10:53:42.363287 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:42.368125 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:53:42.391672 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 10:53:42.398687 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 10:53:42.435414 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:53:42.459064 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 10:53:42.465976 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 10:53:42.984798 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2403 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 10:53:42.990105 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 10:53:43.001082 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:53:43.038848 tst assert_extension.py: using LAC 40430 10:53:43.165094 tst assert_extension.py: using RAC 140 10:53:43.285716 tst assert_extension.py: using CellId 40430 10:53:43.413588 tst assert_extension.py: using BVCI 40431 10:53:43.529775 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 10:53:43.645936 tst assert_extension.py:10: start nitb and bts... 10:53:43.848135 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:53:44.463179 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10408): Launched 10:53:44.767203 run osmo-nitb_10.42.42.2(pid=10409): Launched 10:53:44.935603 run osmo-nitb_10.42.42.2(pid=10409): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10409)] 10:53:45.072349 run osmo-nitb_10.42.42.2(pid=10409): stdout: | (launched: 2022-12-14_10:53:44.710909) 10:53:45.209949 run osmo-nitb_10.42.42.2(pid=10409): stderr: | (launched: 2022-12-14_10:53:44.755897) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:53:45.347522 run osmo-nitb_10.42.42.2(pid=10409): stdout: | (launched: 2022-12-14_10:53:44.710909) 10:53:45.479491 run osmo-nitb_10.42.42.2(pid=10409): stderr: | (launched: 2022-12-14_10:53:44.755897) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10409): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10409) [trial-2403↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10409)] 10:53:45.881547 tst osmo-nitb_10.42.42.2(pid=10409): stdout: | (launched: 2022-12-14_10:53:44.710909) 10:53:46.019712 tst osmo-nitb_10.42.42.2(pid=10409): stderr: | (launched: 2022-12-14_10:53:44.755897) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:53:46.166955 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10409): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10409) [trial-2403↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10409)] [trial-2403↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 10:53:46.176531 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:53:46.184220 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10408): Terminating (SIGTERM) 10:53:46.397416 --- ParallelTerminationStrategy: PID 10408 died... 10:53:46.421809 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10408): Terminated: ok {rc=0} 10:53:46.536574 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 ussd:nanobts+band-1900 --------------------------------------------------------------------- 10:53:47.724433 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:47.731214 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:53:47.756110 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 10:53:47.783869 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 10:53:47.820612 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:53:47.845297 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 10:53:47.872643 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 10:53:48.402852 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2403 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 10:53:48.408428 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:48.420163 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:53:48.458660 tst assert_extension.py: using LAC 40431 10:53:48.585237 tst assert_extension.py: using RAC 141 10:53:48.712668 tst assert_extension.py: using CellId 40431 10:53:48.838628 tst assert_extension.py: using BVCI 40432 10:53:48.956224 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:48.967747 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:48.979112 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:48.990373 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:49.002102 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:53:49.013492 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 10:53:49.130003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:49.599974 run create_hlr_db(pid=10413): Launched 10:53:49.731935 bus /sierra_2: Setting Powered False 10:53:50.795754 run create_hlr_db(pid=10413): Terminated: ok {rc=0} 10:53:51.245793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10415): Launched 10:53:51.569871 run osmo-hlr_10.42.42.2(pid=10416): Launched 10:53:51.693561 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:52.247478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10418): Launched 10:53:52.569703 run osmo-stp_10.42.42.5(pid=10419): Launched 10:53:52.692915 run osmo-msc_10.42.42.6: Starting osmo-msc 10:53:53.273215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10421): Launched 10:53:53.596495 run osmo-msc_10.42.42.6(pid=10422): Launched 10:53:53.775938 run osmo-stp_10.42.42.5(pid=10419): ERR: Terminated: ERROR {rc=1} [trial-2403↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10419)] 10:53:53.910998 run osmo-stp_10.42.42.5(pid=10419): stdout: | (launched: 2022-12-14_10:53:52.510229) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:54.045919 run osmo-stp_10.42.42.5(pid=10419): stderr: | 20221214105352700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105352700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105352700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105352700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105352701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105352701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105352701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:54.180096 run osmo-stp_10.42.42.5(pid=10419): stdout: | (launched: 2022-12-14_10:53:52.510229) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:54.307788 run osmo-stp_10.42.42.5(pid=10419): stderr: | 20221214105352700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105352700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105352700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105352700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105352701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105352701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105352701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:54.461236 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10419): Process ended prematurely: osmo-stp_10.42.42.5(pid=10419) [trial-2403↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10419)] [trial-2403↪ussd:nanobts+band-1900↪assert_extension.py:17] 10:53:54.470609 tst assert_extension.py:17: Test FAILED (6.1 sec) 10:53:54.498617 run osmo-hlr_10.42.42.2(pid=10416): ERR: Terminated: ERROR {rc=237} [trial-2403↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10416)] 10:53:54.550215 run osmo-hlr_10.42.42.2(pid=10416): stdout: | (launched: 2022-12-14_10:53:51.510306) 10:53:54.603420 run osmo-hlr_10.42.42.2(pid=10416): stderr: | 20221214105351707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105351707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105351707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105351707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105351707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105351708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105351723 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105351732 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105351733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105351733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:54.676889 run osmo-msc_10.42.42.6(pid=10422): ERR: Terminated: ERROR {rc=2} [trial-2403↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10422)] 10:53:54.727423 run osmo-msc_10.42.42.6(pid=10422): stdout: | (launched: 2022-12-14_10:53:53.537260) 10:53:54.779803 run osmo-msc_10.42.42.6(pid=10422): stderr: | 20221214105353858 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105353858 DLGLOBAL DEBUG validating counter group 0x7fd292dcec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105353858 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105353858 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105353858 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105353859 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105353860 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105353861 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105353861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105353861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:53:54.832803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10415): Terminating (SIGTERM) 10:53:54.875155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10418): Terminating (SIGTERM) 10:53:54.917649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10421): Terminating (SIGTERM) 10:53:54.960778 --- ParallelTerminationStrategy: PID 10415 died... 10:53:54.981379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10415): Terminated: ok {rc=0} 10:53:55.028506 --- ParallelTerminationStrategy: PID 10418 died... 10:53:55.048615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10418): Terminated: ok {rc=0} 10:53:55.095993 --- ParallelTerminationStrategy: PID 10421 died... 10:53:55.116061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10421): Terminated: ok {rc=0} 10:53:55.204721 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:53:56.407461 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:56.415364 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:53:56.439411 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:53:56.467729 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:53:56.520252 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:53:56.545268 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:53:56.572806 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:53:57.121558 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:53:57.173094 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:53:57.184400 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:53:57.243798 tst mo_mt_call.py: using LAC 40432 10:53:57.369448 tst mo_mt_call.py: using RAC 142 10:53:57.489254 tst mo_mt_call.py: using CellId 40432 10:53:57.608167 tst mo_mt_call.py: using BVCI 40433 10:53:57.719259 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:53:57.730478 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:53:57.741596 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:53:57.752510 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:53:57.763921 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:53:57.775173 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:53:57.891468 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:53:58.007845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:58.481104 run create_hlr_db(pid=10427): Launched 10:53:58.597774 bus /sierra_2: Setting Powered False 10:53:59.662031 run create_hlr_db(pid=10427): Terminated: ok {rc=0} 10:54:00.116364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10429): Launched 10:54:00.443949 run osmo-hlr_10.42.42.2(pid=10430): Launched 10:54:00.571166 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:01.193103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10432): Launched 10:54:01.552721 run osmo-stp_10.42.42.5(pid=10433): Launched 10:54:01.737125 run osmo-msc_10.42.42.6: Starting osmo-msc 10:54:02.468897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10483): Launched 10:54:02.826501 run osmo-msc_10.42.42.6(pid=10490): Launched 10:54:03.221618 run osmo-stp_10.42.42.5(pid=10433): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10433)] 10:54:03.530772 run osmo-stp_10.42.42.5(pid=10433): stdout: | (launched: 2022-12-14_10:54:01.492216) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:03.876926 run osmo-stp_10.42.42.5(pid=10433): stderr: | 20221214105401777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105401777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105401781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105401781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105401783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105401783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105401783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:04.090901 run osmo-stp_10.42.42.5(pid=10433): stdout: | (launched: 2022-12-14_10:54:01.492216) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:04.238806 run osmo-stp_10.42.42.5(pid=10433): stderr: | 20221214105401777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105401777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105401781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105401781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105401783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105401783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105401783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:04.427097 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10433): Process ended prematurely: osmo-stp_10.42.42.5(pid=10433) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10433)] [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:54:04.437597 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 10:54:04.473123 run osmo-hlr_10.42.42.2(pid=10430): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10430)] 10:54:04.536737 run osmo-hlr_10.42.42.2(pid=10430): stdout: | (launched: 2022-12-14_10:54:00.383578) 10:54:04.600788 run osmo-hlr_10.42.42.2(pid=10430): stderr: | 20221214105400583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105400583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105400583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105400583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105400583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105400583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105400595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105400604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105400604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105400604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:04.690242 run osmo-msc_10.42.42.6(pid=10490): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10490)] 10:54:04.741598 run osmo-msc_10.42.42.6(pid=10490): stdout: | (launched: 2022-12-14_10:54:02.758850) 10:54:04.794768 run osmo-msc_10.42.42.6(pid=10490): stderr: | 20221214105403430 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105403430 DLGLOBAL DEBUG validating counter group 0x7fa7a22acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105403430 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105403430 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105403430 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105403431 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105403432 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105403441 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105403441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105403441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:54:04.848670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10429): Terminating (SIGTERM) 10:54:04.904063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10432): Terminating (SIGTERM) 10:54:04.952793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10483): Terminating (SIGTERM) 10:54:04.996329 --- ParallelTerminationStrategy: PID 10429 died... 10:54:05.017111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10429): Terminated: ok {rc=0} 10:54:05.064669 --- ParallelTerminationStrategy: PID 10432 died... 10:54:05.085219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10432): Terminated: ok {rc=0} 10:54:05.132717 --- ParallelTerminationStrategy: PID 10483 died... 10:54:05.153427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10483): Terminated: ok {rc=0} 10:54:05.244756 bus /sierra_3: Setting Powered False 10:54:06.348397 bus /sierra_3: Setting Powered False 10:54:07.474533 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:54:08.624173 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:54:08.636932 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:54:08.700660 tst mo_mt_call_osmux.py: using LAC 40433 10:54:08.824518 tst mo_mt_call_osmux.py: using RAC 143 10:54:08.949416 tst mo_mt_call_osmux.py: using CellId 40433 10:54:09.071867 tst mo_mt_call_osmux.py: using BVCI 40434 10:54:09.187514 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:54:09.199841 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:54:09.211954 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:54:09.223912 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:54:09.237273 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:54:09.250384 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:54:09.375991 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:54:09.496751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:09.990401 run create_hlr_db(pid=10711): Launched 10:54:10.154878 bus /sierra_2: Setting Powered False 10:54:11.222082 run create_hlr_db(pid=10711): Terminated: ok {rc=0} 10:54:11.694667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10713): Launched 10:54:12.044043 run osmo-hlr_10.42.42.2(pid=10714): Launched 10:54:12.296422 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:12.973978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10716): Launched 10:54:13.322468 run osmo-stp_10.42.42.5(pid=10717): Launched 10:54:13.576142 run osmo-msc_10.42.42.6: Starting osmo-msc 10:54:14.259706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10719): Launched 10:54:14.611163 run osmo-msc_10.42.42.6(pid=10720): Launched 10:54:14.983198 run osmo-stp_10.42.42.5(pid=10717): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10717)] 10:54:15.279104 run osmo-stp_10.42.42.5(pid=10717): stdout: | (launched: 2022-12-14_10:54:13.261490) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:15.444819 run osmo-stp_10.42.42.5(pid=10717): stderr: | 20221214105413552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105413552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105413552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105413558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105413558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105413559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105413559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:15.587615 run osmo-stp_10.42.42.5(pid=10717): stdout: | (launched: 2022-12-14_10:54:13.261490) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:15.722075 run osmo-stp_10.42.42.5(pid=10717): stderr: | 20221214105413552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105413552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105413552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105413558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105413558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105413559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105413559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:15.919424 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10717): Process ended prematurely: osmo-stp_10.42.42.5(pid=10717) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10717)] [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:54:15.937712 tst mo_mt_call_osmux.py:8: Test FAILED (7.3 sec) 10:54:15.971426 run osmo-hlr_10.42.42.2(pid=10714): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10714)] 10:54:16.036055 run osmo-hlr_10.42.42.2(pid=10714): stdout: | (launched: 2022-12-14_10:54:11.983355) 10:54:16.090600 run osmo-hlr_10.42.42.2(pid=10714): stderr: | 20221214105412289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105412289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105412289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105412289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105412289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105412289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105412305 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105412315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105412316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105412316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:16.166678 run osmo-msc_10.42.42.6(pid=10720): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10720)] 10:54:16.219107 run osmo-msc_10.42.42.6(pid=10720): stdout: | (launched: 2022-12-14_10:54:14.547243) 10:54:16.278687 run osmo-msc_10.42.42.6(pid=10720): stderr: | 20221214105415046 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105415046 DLGLOBAL DEBUG validating counter group 0x7f62cf21bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105415046 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105415046 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105415047 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105415047 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105415048 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105415057 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105415057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105415058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:54:16.363650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10713): Terminating (SIGTERM) 10:54:16.425395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10716): Terminating (SIGTERM) 10:54:16.478993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10719): Terminating (SIGTERM) 10:54:16.536789 --- ParallelTerminationStrategy: PID 10713 died... 10:54:16.562396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10713): Terminated: ok {rc=0} 10:54:16.623048 --- ParallelTerminationStrategy: PID 10716 died... 10:54:16.646974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10716): Terminated: ok {rc=0} 10:54:16.703922 --- ParallelTerminationStrategy: PID 10719 died... 10:54:16.729452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10719): Terminated: ok {rc=0} 10:54:16.843931 bus /sierra_3: Setting Powered False 10:54:17.995016 bus /sierra_3: Setting Powered False 10:54:19.115327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:54:20.372535 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:54:20.381550 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:54:20.407611 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:54:20.438156 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:54:20.491854 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:54:20.517355 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:54:20.547892 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:54:21.099214 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:54:21.154733 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:54:21.167219 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:54:21.232235 tst mo_mt_call.py: using LAC 40434 10:54:21.365705 tst mo_mt_call.py: using RAC 144 10:54:21.492341 tst mo_mt_call.py: using CellId 40434 10:54:21.621155 tst mo_mt_call.py: using BVCI 40435 10:54:21.744393 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:54:21.757308 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:54:21.769772 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:54:21.782256 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:54:21.795686 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:54:21.809829 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:54:21.934649 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:54:22.058000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:22.569695 run create_hlr_db(pid=10725): Launched 10:54:22.740237 bus /sierra_2: Setting Powered False 10:54:23.805702 run create_hlr_db(pid=10725): Terminated: ok {rc=0} 10:54:24.277027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10727): Launched 10:54:24.625497 run osmo-hlr_10.42.42.2(pid=10728): Launched 10:54:24.879081 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:25.543044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10731): Launched 10:54:25.866643 run osmo-stp_10.42.42.5(pid=10732): Launched 10:54:25.990783 run osmo-msc_10.42.42.6: Starting osmo-msc 10:54:26.575769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10734): Launched 10:54:26.899318 run osmo-msc_10.42.42.6(pid=10735): Launched 10:54:27.078256 run osmo-stp_10.42.42.5(pid=10732): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10732)] 10:54:27.213404 run osmo-stp_10.42.42.5(pid=10732): stdout: | (launched: 2022-12-14_10:54:25.807234) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:27.350646 run osmo-stp_10.42.42.5(pid=10732): stderr: | 20221214105425997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105425997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105425997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105425997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105425998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105425998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105425998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:27.486111 run osmo-stp_10.42.42.5(pid=10732): stdout: | (launched: 2022-12-14_10:54:25.807234) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:27.613768 run osmo-stp_10.42.42.5(pid=10732): stderr: | 20221214105425997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105425997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105425997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105425997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105425998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105425998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105425998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:27.767172 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10732): Process ended prematurely: osmo-stp_10.42.42.5(pid=10732) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10732)] [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:54:27.776759 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 10:54:27.804520 run osmo-hlr_10.42.42.2(pid=10728): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10728)] 10:54:27.854660 run osmo-hlr_10.42.42.2(pid=10728): stdout: | (launched: 2022-12-14_10:54:24.564202) 10:54:27.906573 run osmo-hlr_10.42.42.2(pid=10728): stderr: | 20221214105424871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105424871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105424871 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105424871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105424871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105424871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105424891 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105424907 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105424907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105424907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:27.979020 run osmo-msc_10.42.42.6(pid=10735): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10735)] 10:54:28.029127 run osmo-msc_10.42.42.6(pid=10735): stdout: | (launched: 2022-12-14_10:54:26.839052) 10:54:28.080796 run osmo-msc_10.42.42.6(pid=10735): stderr: | 20221214105427160 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105427160 DLGLOBAL DEBUG validating counter group 0x7efc41a65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105427160 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105427160 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105427160 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105427161 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105427162 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105427163 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105427163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105427163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:54:28.132586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10727): Terminating (SIGTERM) 10:54:28.174208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10731): Terminating (SIGTERM) 10:54:28.215634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10734): Terminating (SIGTERM) 10:54:28.257466 --- ParallelTerminationStrategy: PID 10727 died... 10:54:28.277497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10727): Terminated: ok {rc=0} 10:54:28.323105 --- ParallelTerminationStrategy: PID 10731 died... 10:54:28.342718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10731): Terminated: ok {rc=0} 10:54:28.388219 --- ParallelTerminationStrategy: PID 10734 died... 10:54:28.407741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10734): Terminated: ok {rc=0} 10:54:28.495460 bus /sierra_3: Setting Powered False 10:54:29.591616 bus /sierra_3: Setting Powered False 10:54:30.708522 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:54:31.895707 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:54:31.912792 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:54:31.978771 tst mo_mt_call_osmux.py: using LAC 40435 10:54:32.128040 tst mo_mt_call_osmux.py: using RAC 145 10:54:32.255198 tst mo_mt_call_osmux.py: using CellId 40435 10:54:32.382601 tst mo_mt_call_osmux.py: using BVCI 40436 10:54:32.501425 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:54:32.513072 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:54:32.524546 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:54:32.536023 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:54:32.547575 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:54:32.559173 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:54:32.676762 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:54:32.798591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:33.271235 run create_hlr_db(pid=10737): Launched 10:54:33.389337 bus /sierra_2: Setting Powered False 10:54:34.449535 run create_hlr_db(pid=10737): Terminated: ok {rc=0} 10:54:34.892612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10739): Launched 10:54:35.217989 run osmo-hlr_10.42.42.2(pid=10740): Launched 10:54:35.342662 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:35.903741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10742): Launched 10:54:36.226177 run osmo-stp_10.42.42.5(pid=10743): Launched 10:54:36.350508 run osmo-msc_10.42.42.6: Starting osmo-msc 10:54:36.936068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10745): Launched 10:54:37.262888 run osmo-msc_10.42.42.6(pid=10746): Launched 10:54:37.445322 run osmo-stp_10.42.42.5(pid=10743): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10743)] 10:54:37.581225 run osmo-stp_10.42.42.5(pid=10743): stdout: | (launched: 2022-12-14_10:54:36.166639) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:37.717484 run osmo-stp_10.42.42.5(pid=10743): stderr: | 20221214105436358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105436359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105436359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105436359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105436360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105436360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105436360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:37.852223 run osmo-stp_10.42.42.5(pid=10743): stdout: | (launched: 2022-12-14_10:54:36.166639) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:37.980286 run osmo-stp_10.42.42.5(pid=10743): stderr: | 20221214105436358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105436359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105436359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105436359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105436360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105436360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105436360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:38.133784 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10743): Process ended prematurely: osmo-stp_10.42.42.5(pid=10743) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10743)] [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:54:38.143669 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:54:38.171763 run osmo-hlr_10.42.42.2(pid=10740): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10740)] 10:54:38.221931 run osmo-hlr_10.42.42.2(pid=10740): stdout: | (launched: 2022-12-14_10:54:35.158276) 10:54:38.273866 run osmo-hlr_10.42.42.2(pid=10740): stderr: | 20221214105435356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105435356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105435356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105435356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105435356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105435356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105435368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105435378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105435379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105435379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:38.346665 run osmo-msc_10.42.42.6(pid=10746): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10746)] 10:54:38.396290 run osmo-msc_10.42.42.6(pid=10746): stdout: | (launched: 2022-12-14_10:54:37.203135) 10:54:38.448361 run osmo-msc_10.42.42.6(pid=10746): stderr: | 20221214105437526 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105437526 DLGLOBAL DEBUG validating counter group 0x7fb7d8dc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105437526 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105437526 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105437526 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105437526 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105437528 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105437529 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105437530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105437530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:54:38.500546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10739): Terminating (SIGTERM) 10:54:38.542283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10742): Terminating (SIGTERM) 10:54:38.584246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10745): Terminating (SIGTERM) 10:54:38.626214 --- ParallelTerminationStrategy: PID 10739 died... 10:54:38.646339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10739): Terminated: ok {rc=0} 10:54:38.692543 --- ParallelTerminationStrategy: PID 10742 died... 10:54:38.712274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10742): Terminated: ok {rc=0} 10:54:38.758043 --- ParallelTerminationStrategy: PID 10745 died... 10:54:38.777618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10745): Terminated: ok {rc=0} 10:54:38.865931 bus /sierra_3: Setting Powered False 10:54:39.964069 bus /sierra_3: Setting Powered False 10:54:41.083406 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:54:42.327889 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:54:42.337225 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:54:42.360582 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:54:42.387921 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:54:42.438060 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:54:42.461801 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:54:42.488455 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:54:43.042907 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:54:43.094464 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:54:43.106101 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:54:43.169157 tst mo_mt_call.py: using LAC 40436 10:54:43.294013 tst mo_mt_call.py: using RAC 146 10:54:43.417395 tst mo_mt_call.py: using CellId 40436 10:54:43.542493 tst mo_mt_call.py: using BVCI 40437 10:54:43.658776 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:54:43.670544 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:54:43.681995 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:54:43.693485 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:54:43.705068 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:54:43.716611 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:54:43.838048 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:54:43.957107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:44.425261 run create_hlr_db(pid=10751): Launched 10:54:44.542506 bus /sierra_2: Setting Powered False 10:54:45.606193 run create_hlr_db(pid=10751): Terminated: ok {rc=0} 10:54:46.085672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10753): Launched 10:54:46.427685 run osmo-hlr_10.42.42.2(pid=10754): Launched 10:54:46.647245 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:47.383963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10756): Launched 10:54:47.717290 run osmo-stp_10.42.42.5(pid=10757): Launched 10:54:47.839174 run osmo-msc_10.42.42.6: Starting osmo-msc 10:54:48.422688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10759): Launched 10:54:48.748873 run osmo-msc_10.42.42.6(pid=10760): Launched 10:54:48.928763 run osmo-stp_10.42.42.5(pid=10757): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10757)] 10:54:49.064798 run osmo-stp_10.42.42.5(pid=10757): stdout: | (launched: 2022-12-14_10:54:47.657068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:49.200775 run osmo-stp_10.42.42.5(pid=10757): stderr: | 20221214105447849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105447849 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105447850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105447850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105447850 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105447851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105447851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:49.336568 run osmo-stp_10.42.42.5(pid=10757): stdout: | (launched: 2022-12-14_10:54:47.657068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:49.465048 run osmo-stp_10.42.42.5(pid=10757): stderr: | 20221214105447849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105447849 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105447850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105447850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105447850 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105447851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105447851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:49.619560 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10757): Process ended prematurely: osmo-stp_10.42.42.5(pid=10757) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10757)] [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:54:49.629158 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:54:49.656929 run osmo-hlr_10.42.42.2(pid=10754): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10754)] 10:54:49.706941 run osmo-hlr_10.42.42.2(pid=10754): stdout: | (launched: 2022-12-14_10:54:46.364855) 10:54:49.759023 run osmo-hlr_10.42.42.2(pid=10754): stderr: | 20221214105446701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105446701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105446701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105446702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105446702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105446702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105446718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105446742 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105446742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105446742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:49.831641 run osmo-msc_10.42.42.6(pid=10760): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10760)] 10:54:49.881347 run osmo-msc_10.42.42.6(pid=10760): stdout: | (launched: 2022-12-14_10:54:48.689107) 10:54:49.933119 run osmo-msc_10.42.42.6(pid=10760): stderr: | 20221214105449011 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105449011 DLGLOBAL DEBUG validating counter group 0x7f9653632c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105449011 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105449011 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105449011 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105449012 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105449013 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105449014 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105449014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105449014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:54:49.984895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10753): Terminating (SIGTERM) 10:54:50.026775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10756): Terminating (SIGTERM) 10:54:50.068529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10759): Terminating (SIGTERM) 10:54:50.110478 --- ParallelTerminationStrategy: PID 10753 died... 10:54:50.130696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10753): Terminated: ok {rc=0} 10:54:50.176607 --- ParallelTerminationStrategy: PID 10756 died... 10:54:50.196178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10756): Terminated: ok {rc=0} 10:54:50.241794 --- ParallelTerminationStrategy: PID 10759 died... 10:54:50.261548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10759): Terminated: ok {rc=0} 10:54:50.348512 bus /sierra_3: Setting Powered False 10:54:51.447733 bus /sierra_3: Setting Powered False 10:54:52.566401 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:54:53.712572 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:54:53.724676 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:54:53.790466 tst mo_mt_call_osmux.py: using LAC 40437 10:54:53.909588 tst mo_mt_call_osmux.py: using RAC 147 10:54:54.035901 tst mo_mt_call_osmux.py: using CellId 40437 10:54:54.161411 tst mo_mt_call_osmux.py: using BVCI 40438 10:54:54.274883 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:54:54.286466 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:54:54.297758 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:54:54.309072 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:54:54.320772 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:54:54.332743 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:54:54.450181 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:54:54.571733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:55.072728 run create_hlr_db(pid=10762): Launched 10:54:55.205085 bus /sierra_2: Setting Powered False 10:54:56.268807 run create_hlr_db(pid=10762): Terminated: ok {rc=0} 10:54:56.702782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10764): Launched 10:54:57.006367 run osmo-hlr_10.42.42.2(pid=10765): Launched 10:54:57.122527 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:57.656196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10767): Launched 10:54:57.960687 run osmo-stp_10.42.42.5(pid=10768): Launched 10:54:58.076607 run osmo-msc_10.42.42.6: Starting osmo-msc 10:54:58.631051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10770): Launched 10:54:58.936687 run osmo-msc_10.42.42.6(pid=10771): Launched 10:54:59.107353 run osmo-stp_10.42.42.5(pid=10768): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10768)] 10:54:59.236816 run osmo-stp_10.42.42.5(pid=10768): stdout: | (launched: 2022-12-14_10:54:57.904544) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:59.366150 run osmo-stp_10.42.42.5(pid=10768): stderr: | 20221214105458072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105458072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105458072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105458073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105458073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105458073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105458073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:59.492861 run osmo-stp_10.42.42.5(pid=10768): stdout: | (launched: 2022-12-14_10:54:57.904544) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:59.613704 run osmo-stp_10.42.42.5(pid=10768): stderr: | 20221214105458072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105458072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105458072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105458073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105458073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105458073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105458073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:59.758012 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10768): Process ended prematurely: osmo-stp_10.42.42.5(pid=10768) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10768)] [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:54:59.767189 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:54:59.793711 run osmo-hlr_10.42.42.2(pid=10765): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10765)] 10:54:59.842160 run osmo-hlr_10.42.42.2(pid=10765): stdout: | (launched: 2022-12-14_10:54:56.950458) 10:54:59.891592 run osmo-hlr_10.42.42.2(pid=10765): stderr: | 20221214105457123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105457124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105457124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105457124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105457124 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105457124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105457137 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105457147 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105457148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105457148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:59.960614 run osmo-msc_10.42.42.6(pid=10771): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10771)] 10:55:00.007929 run osmo-msc_10.42.42.6(pid=10771): stdout: | (launched: 2022-12-14_10:54:58.879703) 10:55:00.057570 run osmo-msc_10.42.42.6(pid=10771): stderr: | 20221214105459149 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105459150 DLGLOBAL DEBUG validating counter group 0x7fb6c644ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105459150 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105459150 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105459150 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105459150 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105459152 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105459153 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105459153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105459153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:55:00.107639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10764): Terminating (SIGTERM) 10:55:00.147663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10767): Terminating (SIGTERM) 10:55:00.187602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10770): Terminating (SIGTERM) 10:55:00.227986 --- ParallelTerminationStrategy: PID 10764 died... 10:55:00.247779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10764): Terminated: ok {rc=0} 10:55:00.291828 --- ParallelTerminationStrategy: PID 10767 died... 10:55:00.310617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10767): Terminated: ok {rc=0} 10:55:00.354545 --- ParallelTerminationStrategy: PID 10770 died... 10:55:00.373539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10770): Terminated: ok {rc=0} 10:55:00.460096 bus /sierra_3: Setting Powered False 10:55:01.578652 bus /sierra_3: Setting Powered False 10:55:02.695472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:55:03.941267 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:55:03.949538 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:55:03.973093 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:55:04.000566 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:55:04.050179 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:55:04.073869 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:55:04.100378 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:55:04.653686 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:55:04.702770 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:55:04.714273 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:55:04.772531 tst mo_mt_call.py: using LAC 40438 10:55:04.889345 tst mo_mt_call.py: using RAC 148 10:55:05.005883 tst mo_mt_call.py: using CellId 40438 10:55:05.123289 tst mo_mt_call.py: using BVCI 40439 10:55:05.232677 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:55:05.244109 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:55:05.255355 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:55:05.266583 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:55:05.278187 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:55:05.289807 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:55:05.410138 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:55:05.528412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:05.998697 run create_hlr_db(pid=10779): Launched 10:55:06.116609 bus /sierra_2: Setting Powered False 10:55:07.176735 run create_hlr_db(pid=10779): Terminated: ok {rc=0} 10:55:07.600332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10781): Launched 10:55:07.904291 run osmo-hlr_10.42.42.2(pid=10782): Launched 10:55:08.020066 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:08.554706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10784): Launched 10:55:08.859954 run osmo-stp_10.42.42.5(pid=10785): Launched 10:55:08.976082 run osmo-msc_10.42.42.6: Starting osmo-msc 10:55:09.523334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10787): Launched 10:55:09.829682 run osmo-msc_10.42.42.6(pid=10788): Launched 10:55:10.000672 run osmo-stp_10.42.42.5(pid=10785): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10785)] 10:55:10.129700 run osmo-stp_10.42.42.5(pid=10785): stdout: | (launched: 2022-12-14_10:55:08.803704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:10.258537 run osmo-stp_10.42.42.5(pid=10785): stderr: | 20221214105508971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105508971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105508971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105508972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105508972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105508972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105508972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:10.385433 run osmo-stp_10.42.42.5(pid=10785): stdout: | (launched: 2022-12-14_10:55:08.803704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:10.505579 run osmo-stp_10.42.42.5(pid=10785): stderr: | 20221214105508971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105508971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105508971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105508972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105508972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105508972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105508972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:10.650218 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10785): Process ended prematurely: osmo-stp_10.42.42.5(pid=10785) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10785)] [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:55:10.659261 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:55:10.685915 run osmo-hlr_10.42.42.2(pid=10782): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10782)] 10:55:10.734404 run osmo-hlr_10.42.42.2(pid=10782): stdout: | (launched: 2022-12-14_10:55:07.847958) 10:55:10.784166 run osmo-hlr_10.42.42.2(pid=10782): stderr: | 20221214105508024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105508024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105508024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105508024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105508024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105508024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105508036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105508044 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105508044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105508044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:10.854457 run osmo-msc_10.42.42.6(pid=10788): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10788)] 10:55:10.902172 run osmo-msc_10.42.42.6(pid=10788): stdout: | (launched: 2022-12-14_10:55:09.772485) 10:55:10.952046 run osmo-msc_10.42.42.6(pid=10788): stderr: | 20221214105510043 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105510044 DLGLOBAL DEBUG validating counter group 0x7fc712ccbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105510044 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105510044 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105510044 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105510044 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105510046 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105510046 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105510047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105510047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:55:11.002180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10781): Terminating (SIGTERM) 10:55:11.042428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10784): Terminating (SIGTERM) 10:55:11.082656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10787): Terminating (SIGTERM) 10:55:11.123287 --- ParallelTerminationStrategy: PID 10781 died... 10:55:11.143183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10781): Terminated: ok {rc=0} 10:55:11.187454 --- ParallelTerminationStrategy: PID 10784 died... 10:55:11.206542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10784): Terminated: ok {rc=0} 10:55:11.250757 --- ParallelTerminationStrategy: PID 10787 died... 10:55:11.269843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10787): Terminated: ok {rc=0} 10:55:11.356294 bus /sierra_3: Setting Powered False 10:55:12.456177 bus /sierra_3: Setting Powered False 10:55:13.569506 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:55:14.718865 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:55:14.731283 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:55:14.793246 tst mo_mt_call_osmux.py: using LAC 40439 10:55:14.918582 tst mo_mt_call_osmux.py: using RAC 149 10:55:15.045147 tst mo_mt_call_osmux.py: using CellId 40439 10:55:15.182007 tst mo_mt_call_osmux.py: using BVCI 40440 10:55:15.294075 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:55:15.305412 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:55:15.316498 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:55:15.327691 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:55:15.339637 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:55:15.351537 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:55:15.473961 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:55:15.596711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:16.121870 run create_hlr_db(pid=10790): Launched 10:55:16.288017 bus /sierra_2: Setting Powered False 10:55:17.349051 run create_hlr_db(pid=10790): Terminated: ok {rc=0} 10:55:17.803784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10792): Launched 10:55:18.130507 run osmo-hlr_10.42.42.2(pid=10793): Launched 10:55:18.255306 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:18.812611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10795): Launched 10:55:19.137630 run osmo-stp_10.42.42.5(pid=10796): Launched 10:55:19.260787 run osmo-msc_10.42.42.6: Starting osmo-msc 10:55:19.848023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10798): Launched 10:55:20.175356 run osmo-msc_10.42.42.6(pid=10799): Launched 10:55:20.355497 run osmo-stp_10.42.42.5(pid=10796): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10796)] 10:55:20.491822 run osmo-stp_10.42.42.5(pid=10796): stdout: | (launched: 2022-12-14_10:55:19.077536) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:20.628540 run osmo-stp_10.42.42.5(pid=10796): stderr: | 20221214105519267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105519267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105519267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105519267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105519268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105519268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105519268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:20.763939 run osmo-stp_10.42.42.5(pid=10796): stdout: | (launched: 2022-12-14_10:55:19.077536) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:20.892521 run osmo-stp_10.42.42.5(pid=10796): stderr: | 20221214105519267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105519267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105519267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105519267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105519268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105519268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105519268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:21.046733 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10796): Process ended prematurely: osmo-stp_10.42.42.5(pid=10796) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10796)] [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:55:21.056621 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:55:21.084773 run osmo-hlr_10.42.42.2(pid=10793): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10793)] 10:55:21.135365 run osmo-hlr_10.42.42.2(pid=10793): stdout: | (launched: 2022-12-14_10:55:18.070853) 10:55:21.187766 run osmo-hlr_10.42.42.2(pid=10793): stderr: | 20221214105518266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105518266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105518266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105518267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105518267 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105518267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105518279 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105518288 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105518288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105518288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:21.260540 run osmo-msc_10.42.42.6(pid=10799): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10799)] 10:55:21.310434 run osmo-msc_10.42.42.6(pid=10799): stdout: | (launched: 2022-12-14_10:55:20.114902) 10:55:21.362347 run osmo-msc_10.42.42.6(pid=10799): stderr: | 20221214105520434 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105520435 DLGLOBAL DEBUG validating counter group 0x7f4096a0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105520435 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105520435 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105520435 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105520435 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105520437 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105520437 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105520437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105520438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:55:21.414692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10792): Terminating (SIGTERM) 10:55:21.457066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10795): Terminating (SIGTERM) 10:55:21.499494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10798): Terminating (SIGTERM) 10:55:21.542181 --- ParallelTerminationStrategy: PID 10792 died... 10:55:21.562654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10792): Terminated: ok {rc=0} 10:55:21.609666 --- ParallelTerminationStrategy: PID 10795 died... 10:55:21.629751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10795): Terminated: ok {rc=0} 10:55:21.676458 --- ParallelTerminationStrategy: PID 10798 died... 10:55:21.696500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10798): Terminated: ok {rc=0} 10:55:21.785872 bus /sierra_3: Setting Powered False 10:55:22.885124 bus /sierra_3: Setting Powered False 10:55:24.002625 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:55:25.240838 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:55:25.248327 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:55:25.271750 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:55:25.299313 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:55:25.352244 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:55:25.377454 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:55:25.406256 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:55:25.956091 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:55:26.008881 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:55:26.020807 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:55:26.083871 tst mo_mt_call.py: using LAC 40440 10:55:26.211528 tst mo_mt_call.py: using RAC 150 10:55:26.339717 tst mo_mt_call.py: using CellId 40440 10:55:26.467859 tst mo_mt_call.py: using BVCI 40441 10:55:26.584533 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:55:26.596268 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:55:26.608177 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:55:26.619848 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:55:26.631496 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:55:26.643073 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:55:26.761420 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:55:26.878867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:27.349495 run create_hlr_db(pid=10804): Launched 10:55:27.466616 bus /sierra_2: Setting Powered False 10:55:28.527252 run create_hlr_db(pid=10804): Terminated: ok {rc=0} 10:55:28.969679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10806): Launched 10:55:29.280156 run osmo-hlr_10.42.42.2(pid=10807): Launched 10:55:29.395117 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:29.914677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10809): Launched 10:55:30.215102 run osmo-stp_10.42.42.5(pid=10810): Launched 10:55:30.329150 run osmo-msc_10.42.42.6: Starting osmo-msc 10:55:30.901616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10812): Launched 10:55:31.237644 run osmo-msc_10.42.42.6(pid=10813): Launched 10:55:31.669651 run osmo-stp_10.42.42.5(pid=10810): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10810)] 10:55:31.930980 run osmo-stp_10.42.42.5(pid=10810): stdout: | (launched: 2022-12-14_10:55:30.159628) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:32.099737 run osmo-stp_10.42.42.5(pid=10810): stderr: | 20221214105530326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105530327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105530327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105530327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105530328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105530328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105530328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:32.251617 run osmo-stp_10.42.42.5(pid=10810): stdout: | (launched: 2022-12-14_10:55:30.159628) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:32.390706 run osmo-stp_10.42.42.5(pid=10810): stderr: | 20221214105530326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105530327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105530327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105530327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105530328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105530328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105530328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:32.535290 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10810): Process ended prematurely: osmo-stp_10.42.42.5(pid=10810) [trial-2403↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10810)] [trial-2403↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:55:32.544568 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:55:32.571466 run osmo-hlr_10.42.42.2(pid=10807): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10807)] 10:55:32.620768 run osmo-hlr_10.42.42.2(pid=10807): stdout: | (launched: 2022-12-14_10:55:29.224436) 10:55:32.671406 run osmo-hlr_10.42.42.2(pid=10807): stderr: | 20221214105529396 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105529397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105529397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105529397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105529397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105529397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105529409 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105529417 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105529417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105529417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:32.742222 run osmo-msc_10.42.42.6(pid=10813): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10813)] 10:55:32.790158 run osmo-msc_10.42.42.6(pid=10813): stdout: | (launched: 2022-12-14_10:55:31.173224) 10:55:32.840381 run osmo-msc_10.42.42.6(pid=10813): stderr: | 20221214105531545 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105531545 DLGLOBAL DEBUG validating counter group 0x7fba5feffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105531546 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105531546 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105531546 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105531547 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105531552 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105531553 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105531553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105531553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:55:32.890953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10806): Terminating (SIGTERM) 10:55:32.931684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10809): Terminating (SIGTERM) 10:55:32.972238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10812): Terminating (SIGTERM) 10:55:33.013069 --- ParallelTerminationStrategy: PID 10806 died... 10:55:33.033129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10806): Terminated: ok {rc=0} 10:55:33.077939 --- ParallelTerminationStrategy: PID 10809 died... 10:55:33.097453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10809): Terminated: ok {rc=0} 10:55:33.142307 --- ParallelTerminationStrategy: PID 10812 died... 10:55:33.161778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10812): Terminated: ok {rc=0} 10:55:33.248074 bus /sierra_3: Setting Powered False 10:55:34.347404 bus /sierra_3: Setting Powered False 10:55:35.459200 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:55:36.608029 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:55:36.620515 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:55:36.682850 tst mo_mt_call_osmux.py: using LAC 40441 10:55:36.809124 tst mo_mt_call_osmux.py: using RAC 151 10:55:36.935668 tst mo_mt_call_osmux.py: using CellId 40441 10:55:37.063073 tst mo_mt_call_osmux.py: using BVCI 40442 10:55:37.180702 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:55:37.192568 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:55:37.204098 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:55:37.215619 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:55:37.227387 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:55:37.239113 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:55:37.355654 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:55:37.474525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:37.972859 run create_hlr_db(pid=10815): Launched 10:55:38.103833 bus /sierra_2: Setting Powered False 10:55:39.166365 run create_hlr_db(pid=10815): Terminated: ok {rc=0} 10:55:39.596279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10817): Launched 10:55:39.898634 run osmo-hlr_10.42.42.2(pid=10818): Launched 10:55:40.013753 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:40.544852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10820): Launched 10:55:40.846953 run osmo-stp_10.42.42.5(pid=10821): Launched 10:55:40.962012 run osmo-msc_10.42.42.6: Starting osmo-msc 10:55:41.504624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10823): Launched 10:55:41.806459 run osmo-msc_10.42.42.6(pid=10824): Launched 10:55:41.974563 run osmo-stp_10.42.42.5(pid=10821): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10821)] 10:55:42.101218 run osmo-stp_10.42.42.5(pid=10821): stdout: | (launched: 2022-12-14_10:55:40.791087) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:42.228527 run osmo-stp_10.42.42.5(pid=10821): stderr: | 20221214105540958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105540958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105540958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105540959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105540959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105540959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105540959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:42.353561 run osmo-stp_10.42.42.5(pid=10821): stdout: | (launched: 2022-12-14_10:55:40.791087) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:42.472328 run osmo-stp_10.42.42.5(pid=10821): stderr: | 20221214105540958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105540958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105540958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105540959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105540959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105540959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105540959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:42.614995 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10821): Process ended prematurely: osmo-stp_10.42.42.5(pid=10821) [trial-2403↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10821)] [trial-2403↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:55:42.623895 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:55:42.650373 run osmo-hlr_10.42.42.2(pid=10818): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10818)] 10:55:42.698506 run osmo-hlr_10.42.42.2(pid=10818): stdout: | (launched: 2022-12-14_10:55:39.842730) 10:55:42.748183 run osmo-hlr_10.42.42.2(pid=10818): stderr: | 20221214105540016 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105540016 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105540017 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105540017 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105540017 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105540017 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105540029 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105540039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105540039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105540039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:42.817620 run osmo-msc_10.42.42.6(pid=10824): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10824)] 10:55:42.865108 run osmo-msc_10.42.42.6(pid=10824): stdout: | (launched: 2022-12-14_10:55:41.750388) 10:55:42.914385 run osmo-msc_10.42.42.6(pid=10824): stderr: | 20221214105542018 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105542018 DLGLOBAL DEBUG validating counter group 0x7f7b3d0b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105542018 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105542018 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105542019 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105542019 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105542020 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105542021 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105542021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105542021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:55:42.964212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10817): Terminating (SIGTERM) 10:55:43.003915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10820): Terminating (SIGTERM) 10:55:43.043742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10823): Terminating (SIGTERM) 10:55:43.083724 --- ParallelTerminationStrategy: PID 10817 died... 10:55:43.103049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10817): Terminated: ok {rc=0} 10:55:43.146912 --- ParallelTerminationStrategy: PID 10820 died... 10:55:43.165713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10820): Terminated: ok {rc=0} 10:55:43.209441 --- ParallelTerminationStrategy: PID 10823 died... 10:55:43.228301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10823): Terminated: ok {rc=0} 10:55:43.312286 bus /sierra_3: Setting Powered False 10:55:44.407138 bus /sierra_3: Setting Powered False 10:55:45.521488 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 emergency:nanobts+band-1900 --------------------------------------------------------------------- 10:55:46.786638 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:55:46.795306 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:55:46.828016 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 10:55:46.862686 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 10:55:46.967184 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:55:46.999779 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 10:55:47.034648 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 10:55:47.597609 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2403 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 10:55:47.603391 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:55:47.614570 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:55:47.655660 tst emergency_mo_mt_call.py: using LAC 40442 10:55:47.772175 tst emergency_mo_mt_call.py: using RAC 152 10:55:47.887232 tst emergency_mo_mt_call.py: using CellId 40442 10:55:48.006020 tst emergency_mo_mt_call.py: using BVCI 40443 10:55:48.122385 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:55:48.133834 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:55:48.145054 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:55:48.156307 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:55:48.168065 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:55:48.179842 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:55:48.294492 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:55:48.412886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:48.901315 run create_hlr_db(pid=10829): Launched 10:55:49.030110 bus /sierra_2: Setting Powered False 10:55:50.092267 run create_hlr_db(pid=10829): Terminated: ok {rc=0} 10:55:50.514242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10831): Launched 10:55:50.809121 run osmo-hlr_10.42.42.2(pid=10832): Launched 10:55:50.921485 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:51.440403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10834): Launched 10:55:51.736934 run osmo-stp_10.42.42.5(pid=10835): Launched 10:55:51.860188 tst emergency_mo_mt_call.py: using MSISDN 8644 10:55:52.011595 run osmo-msc_10.42.42.6: Starting osmo-msc 10:55:52.542916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10840): Launched 10:55:52.836128 run osmo-msc_10.42.42.6(pid=10841): Launched 10:55:52.999920 run osmo-stp_10.42.42.5(pid=10835): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10835)] 10:55:53.123740 run osmo-stp_10.42.42.5(pid=10835): stdout: | (launched: 2022-12-14_10:55:51.681578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:53.248744 run osmo-stp_10.42.42.5(pid=10835): stderr: | 20221214105551846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105551846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105551847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105551847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105551847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105551848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105551848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:53.371416 run osmo-stp_10.42.42.5(pid=10835): stdout: | (launched: 2022-12-14_10:55:51.681578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:53.488270 run osmo-stp_10.42.42.5(pid=10835): stderr: | 20221214105551846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105551846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105551847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105551847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105551847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105551848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105551848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:53.628193 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10835): Process ended prematurely: osmo-stp_10.42.42.5(pid=10835) [trial-2403↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10835)] [trial-2403↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 10:55:53.636691 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 10:55:53.663331 run osmo-hlr_10.42.42.2(pid=10832): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10832)] 10:55:53.711383 run osmo-hlr_10.42.42.2(pid=10832): stdout: | (launched: 2022-12-14_10:55:50.754627) 10:55:53.760922 run osmo-hlr_10.42.42.2(pid=10832): stderr: | 20221214105550926 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105550927 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105550927 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105550927 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105550927 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105550927 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105550940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105550950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105550951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105550951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:53.830471 run osmo-msc_10.42.42.6(pid=10841): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10841)] 10:55:53.877683 run osmo-msc_10.42.42.6(pid=10841): stdout: | (launched: 2022-12-14_10:55:52.781542) 10:55:53.927179 run osmo-msc_10.42.42.6(pid=10841): stderr: | 20221214105553050 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105553050 DLGLOBAL DEBUG validating counter group 0x7fd237025c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105553050 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105553050 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105553051 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105553051 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105553053 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105553053 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105553053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105553053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:55:53.976819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10831): Terminating (SIGTERM) 10:55:54.016882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10834): Terminating (SIGTERM) 10:55:54.056484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10840): Terminating (SIGTERM) 10:55:54.096319 --- ParallelTerminationStrategy: PID 10831 died... 10:55:54.115749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10831): Terminated: ok {rc=0} 10:55:54.159609 --- ParallelTerminationStrategy: PID 10834 died... 10:55:54.178443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10834): Terminated: ok {rc=0} 10:55:54.222174 --- ParallelTerminationStrategy: PID 10840 died... 10:55:54.241002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10840): Terminated: ok {rc=0} 10:55:54.324661 bus /sierra_3: Setting Powered False 10:55:55.422219 bus /sierra_3: Setting Powered False 10:55:56.537862 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 10:55:57.624776 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:55:57.636650 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:55:57.677627 tst emergency_preemptive_call.py: using LAC 40443 10:55:57.803428 tst emergency_preemptive_call.py: using RAC 153 10:55:57.925115 tst emergency_preemptive_call.py: using CellId 40443 10:55:58.045846 tst emergency_preemptive_call.py: using BVCI 40444 10:55:58.159329 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:55:58.170662 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:55:58.181892 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:55:58.192910 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:55:58.204006 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:55:58.215055 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:55:58.333729 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:55:58.450325 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:55:58.562757 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:55:58.679866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:59.167119 run create_hlr_db(pid=10843): Launched 10:55:59.295679 bus /sierra_2: Setting Powered False 10:56:00.358267 run create_hlr_db(pid=10843): Terminated: ok {rc=0} 10:56:00.780838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10845): Launched 10:56:01.096496 run osmo-hlr_10.42.42.2(pid=10846): Launched 10:56:01.334278 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:02.044463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10848): Launched 10:56:02.377117 run osmo-stp_10.42.42.5(pid=10849): Launched 10:56:02.508546 tst emergency_preemptive_call.py: using MSISDN 8645 10:56:02.670280 run osmo-msc_10.42.42.6: Starting osmo-msc 10:56:03.240162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10851): Launched 10:56:03.557078 run osmo-msc_10.42.42.6(pid=10852): Launched 10:56:03.734407 run osmo-stp_10.42.42.5(pid=10849): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10849)] 10:56:03.871330 run osmo-stp_10.42.42.5(pid=10849): stdout: | (launched: 2022-12-14_10:56:02.318491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:04.008276 run osmo-stp_10.42.42.5(pid=10849): stderr: | 20221214105602505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105602506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105602506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105602507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105602507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105602507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105602507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:04.139994 run osmo-stp_10.42.42.5(pid=10849): stdout: | (launched: 2022-12-14_10:56:02.318491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:04.265636 run osmo-stp_10.42.42.5(pid=10849): stderr: | 20221214105602505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105602506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105602506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105602507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105602507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105602507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105602507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:04.415804 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10849): Process ended prematurely: osmo-stp_10.42.42.5(pid=10849) [trial-2403↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10849)] [trial-2403↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 10:56:04.424873 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 10:56:04.452468 run osmo-hlr_10.42.42.2(pid=10846): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10846)] 10:56:04.503228 run osmo-hlr_10.42.42.2(pid=10846): stdout: | (launched: 2022-12-14_10:56:01.038053) 10:56:04.555368 run osmo-hlr_10.42.42.2(pid=10846): stderr: | 20221214105601374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105601374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105601374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105601374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105601374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105601374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105601394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105601402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105601402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105601402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:04.628167 run osmo-msc_10.42.42.6(pid=10852): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10852)] 10:56:04.678399 run osmo-msc_10.42.42.6(pid=10852): stdout: | (launched: 2022-12-14_10:56:03.498459) 10:56:04.730352 run osmo-msc_10.42.42.6(pid=10852): stderr: | 20221214105603814 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105603815 DLGLOBAL DEBUG validating counter group 0x7fca3e0d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105603815 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105603815 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105603815 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105603815 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105603817 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105603818 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105603818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105603818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:56:04.782846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10845): Terminating (SIGTERM) 10:56:04.825155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10848): Terminating (SIGTERM) 10:56:04.867490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10851): Terminating (SIGTERM) 10:56:04.909855 --- ParallelTerminationStrategy: PID 10845 died... 10:56:04.930016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10845): Terminated: ok {rc=0} 10:56:04.976058 --- ParallelTerminationStrategy: PID 10848 died... 10:56:04.995705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10848): Terminated: ok {rc=0} 10:56:05.042079 --- ParallelTerminationStrategy: PID 10851 died... 10:56:05.061638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10851): Terminated: ok {rc=0} 10:56:05.149224 bus /sierra_9: Setting Powered False 10:56:06.248376 bus /sierra_9: Setting Powered False 10:56:07.364856 bus /sierra_8: Setting Powered False 10:56:08.463567 bus /sierra_8: Setting Powered False 10:56:09.579425 bus /sierra_3: Setting Powered False 10:56:10.678324 bus /sierra_3: Setting Powered False 10:56:11.793455 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-1900 --------------------------------------------------------------------- 10:56:13.068237 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:56:13.073971 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:56:13.098040 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 10:56:13.137485 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 10:56:13.225642 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:56:13.249761 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 10:56:13.288812 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 10:56:13.883456 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 10:56:13.935537 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:13.947034 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:56:13.986623 tst cs_paging_gprs_active.py: using LAC 40444 10:56:14.107557 tst cs_paging_gprs_active.py: using RAC 154 10:56:14.226482 tst cs_paging_gprs_active.py: using CellId 40444 10:56:14.346565 tst cs_paging_gprs_active.py: using BVCI 40445 10:56:14.458055 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:14.468911 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:14.479429 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:14.489912 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:14.500203 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:14.510909 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:14.522349 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:14.533165 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:14.544130 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:56:14.664254 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:56:14.782198 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:56:14.985693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:15.289580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10857): Launched 10:56:15.554095 run iperf3-srv_10.42.42.10(pid=10858): Launched 10:56:15.670239 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:56:15.886363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:16.202500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10859): Launched 10:56:16.487189 run iperf3-srv_10.42.42.10(pid=10860): Launched 10:56:16.619215 tst cs_paging_gprs_active.py:38: start network... 10:56:16.827537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:17.304509 run create_hlr_db(pid=10861): Launched 10:56:17.420296 bus /sierra_2: Setting Powered False 10:56:18.481688 run create_hlr_db(pid=10861): Terminated: ok {rc=0} 10:56:18.923719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10863): Launched 10:56:19.247367 run osmo-hlr_10.42.42.2(pid=10864): Launched 10:56:19.370018 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:19.931504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10866): Launched 10:56:20.255170 run osmo-stp_10.42.42.5(pid=10867): Launched 10:56:20.379135 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:20.934268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10869): Launched 10:56:21.059300 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:21.332629 run patchelf(pid=10870): Launched 10:56:21.515142 run osmo-stp_10.42.42.5(pid=10867): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10867)] 10:56:21.652695 run osmo-stp_10.42.42.5(pid=10867): stdout: | (launched: 2022-12-14_10:56:20.194988) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:21.791094 run osmo-stp_10.42.42.5(pid=10867): stderr: | 20221214105620384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105620385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105620385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105620385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105620386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105620386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105620386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:21.930102 run osmo-stp_10.42.42.5(pid=10867): stdout: | (launched: 2022-12-14_10:56:20.194988) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:22.062530 run osmo-stp_10.42.42.5(pid=10867): stderr: | 20221214105620384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105620385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105620385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105620385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105620386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105620386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105620386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:22.219699 run patchelf(pid=10870): Terminating (SIGINT) 10:56:22.402163 run patchelf(pid=10870): Terminated: ok {rc=0} 10:56:22.533356 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10867): Process ended prematurely: osmo-stp_10.42.42.5(pid=10867) [trial-2403↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10867)] [trial-2403↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 10:56:22.543784 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:56:22.572682 run osmo-hlr_10.42.42.2(pid=10864): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10864)] 10:56:22.623263 run osmo-hlr_10.42.42.2(pid=10864): stdout: | (launched: 2022-12-14_10:56:19.187614) 10:56:22.675958 run osmo-hlr_10.42.42.2(pid=10864): stderr: | 20221214105619382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105619382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105619382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105619382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105619382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105619382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105619395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105619403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105619403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105619403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:22.728780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10857): Terminating (SIGTERM) 10:56:22.770828 run iperf3-srv_10.42.42.10(pid=10858): Terminating (SIGTERM) 10:56:22.813416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10859): Terminating (SIGTERM) 10:56:22.856004 run iperf3-srv_10.42.42.10(pid=10860): Terminating (SIGTERM) 10:56:22.897830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10863): Terminating (SIGTERM) 10:56:22.940209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10866): Terminating (SIGTERM) 10:56:22.982638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10869): Terminating (SIGTERM) 10:56:23.025409 --- ParallelTerminationStrategy: PID 10857 died... 10:56:23.045652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10857): Terminated: ok {rc=0} 10:56:23.092606 --- ParallelTerminationStrategy: PID 10858 died... 10:56:23.112344 run iperf3-srv_10.42.42.10(pid=10858): Terminated {rc=256} 10:56:23.158607 --- ParallelTerminationStrategy: PID 10859 died... 10:56:23.178366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10859): Terminated: ok {rc=0} 10:56:23.224647 --- ParallelTerminationStrategy: PID 10860 died... 10:56:23.244462 run iperf3-srv_10.42.42.10(pid=10860): Terminated {rc=256} 10:56:23.290723 --- ParallelTerminationStrategy: PID 10863 died... 10:56:23.310622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10863): Terminated: ok {rc=0} 10:56:23.357045 --- ParallelTerminationStrategy: PID 10866 died... 10:56:23.377191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10866): Terminated: ok {rc=0} 10:56:23.423382 --- ParallelTerminationStrategy: PID 10869 died... 10:56:23.443268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10869): Terminated: ok {rc=0} 10:56:23.531810 bus /gobi_0: Setting Powered False 10:56:24.633695 bus /gobi_0: Setting Powered False 10:56:25.749819 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 10:56:26.898970 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:26.910735 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:56:26.950569 tst iperf3.py: using LAC 40445 10:56:27.074519 tst iperf3.py: using RAC 155 10:56:27.193388 tst iperf3.py: using CellId 40445 10:56:27.309931 tst iperf3.py: using BVCI 40446 10:56:27.420376 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:27.431086 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:27.442074 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:27.452407 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:27.463214 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:27.474519 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:27.485580 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:27.496524 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:27.507652 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:56:27.630415 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:56:27.831833 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:28.134527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10871): Launched 10:56:28.400553 run iperf3-srv_10.42.42.10(pid=10872): Launched 10:56:28.515001 tst iperf3.py:8: start network... 10:56:28.716361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:29.182076 run create_hlr_db(pid=10873): Launched 10:56:29.299422 bus /gobi_6: Setting Powered False 10:56:30.359452 run create_hlr_db(pid=10873): Terminated: ok {rc=0} 10:56:30.799639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10875): Launched 10:56:31.160892 run osmo-hlr_10.42.42.2(pid=10876): Launched 10:56:31.465588 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:32.124802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10878): Launched 10:56:32.461751 run osmo-stp_10.42.42.5(pid=10879): Launched 10:56:32.586354 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:33.142591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10881): Launched 10:56:33.267672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:33.541041 run patchelf(pid=10882): Launched 10:56:33.721404 run osmo-stp_10.42.42.5(pid=10879): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10879)] 10:56:33.857501 run osmo-stp_10.42.42.5(pid=10879): stdout: | (launched: 2022-12-14_10:56:32.402651) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:33.995632 run osmo-stp_10.42.42.5(pid=10879): stderr: | 20221214105632592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105632592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105632592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105632593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105632593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105632593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105632593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:34.133853 run osmo-stp_10.42.42.5(pid=10879): stdout: | (launched: 2022-12-14_10:56:32.402651) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:34.265727 run osmo-stp_10.42.42.5(pid=10879): stderr: | 20221214105632592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105632592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105632592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105632593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105632593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105632593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105632593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:34.422697 run patchelf(pid=10882): Terminating (SIGINT) 10:56:34.604483 run patchelf(pid=10882): Terminated: ok {rc=0} 10:56:34.735755 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10879): Process ended prematurely: osmo-stp_10.42.42.5(pid=10879) [trial-2403↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10879)] [trial-2403↪gprs:nanobts+band-1900↪iperf3.py:8] 10:56:34.746163 tst iperf3.py:8: Test FAILED (7.9 sec) 10:56:34.775153 run osmo-hlr_10.42.42.2(pid=10876): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10876)] 10:56:34.825613 run osmo-hlr_10.42.42.2(pid=10876): stdout: | (launched: 2022-12-14_10:56:31.100832) 10:56:34.878693 run osmo-hlr_10.42.42.2(pid=10876): stderr: | 20221214105631476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105631476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105631476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105631476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105631476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105631476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105631496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105631512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105631513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105631513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:34.931834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10871): Terminating (SIGTERM) 10:56:34.973688 run iperf3-srv_10.42.42.10(pid=10872): Terminating (SIGTERM) 10:56:35.015648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10875): Terminating (SIGTERM) 10:56:35.057791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10878): Terminating (SIGTERM) 10:56:35.100251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10881): Terminating (SIGTERM) 10:56:35.142910 --- ParallelTerminationStrategy: PID 10871 died... 10:56:35.163230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10871): Terminated: ok {rc=0} 10:56:35.209745 --- ParallelTerminationStrategy: PID 10872 died... 10:56:35.229405 run iperf3-srv_10.42.42.10(pid=10872): Terminated {rc=256} 10:56:35.275677 --- ParallelTerminationStrategy: PID 10875 died... 10:56:35.295375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10875): Terminated: ok {rc=0} 10:56:35.341929 --- ParallelTerminationStrategy: PID 10878 died... 10:56:35.361663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10878): Terminated: ok {rc=0} 10:56:35.407978 --- ParallelTerminationStrategy: PID 10881 died... 10:56:35.427731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10881): Terminated: ok {rc=0} 10:56:35.515988 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 10:56:36.666013 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:36.677912 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:56:36.717850 tst iperf3m4.py: using LAC 40446 10:56:36.844172 tst iperf3m4.py: using RAC 156 10:56:36.974772 tst iperf3m4.py: using CellId 40446 10:56:37.099336 tst iperf3m4.py: using BVCI 40447 10:56:37.217786 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:37.228880 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:37.240020 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:37.251029 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:37.262052 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:37.273166 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:37.284316 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:37.295345 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:37.306617 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:56:37.425220 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:56:37.543813 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:56:37.663087 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:56:37.780573 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:56:37.984845 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:38.290805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10883): Launched 10:56:38.557322 run iperf3-srv_10.42.42.10(pid=10884): Launched 10:56:38.671542 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:56:38.873251 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:39.176580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10885): Launched 10:56:39.440241 run iperf3-srv_10.42.42.10(pid=10886): Launched 10:56:39.554029 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:56:39.755487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:40.058905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10887): Launched 10:56:40.322489 run iperf3-srv_10.42.42.10(pid=10888): Launched 10:56:40.438567 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:56:40.639861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:56:40.943337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10889): Launched 10:56:41.208132 run iperf3-srv_10.42.42.10(pid=10890): Launched 10:56:41.321557 tst iperf3m4.py:8: start network... 10:56:41.522237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:41.988215 run create_hlr_db(pid=10891): Launched 10:56:42.105302 bus /gobi_6: Setting Powered False 10:56:43.165622 run create_hlr_db(pid=10891): Terminated: ok {rc=0} 10:56:43.608625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10893): Launched 10:56:43.934767 run osmo-hlr_10.42.42.2(pid=10894): Launched 10:56:44.057315 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:44.621412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10896): Launched 10:56:44.947392 run osmo-stp_10.42.42.5(pid=10897): Launched 10:56:45.070498 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:56:45.635121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10899): Launched 10:56:45.762944 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:56:46.046124 run patchelf(pid=10900): Launched 10:56:46.271542 run osmo-stp_10.42.42.5(pid=10897): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10897)] 10:56:46.412776 run osmo-stp_10.42.42.5(pid=10897): stdout: | (launched: 2022-12-14_10:56:44.886836) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:46.579640 run osmo-stp_10.42.42.5(pid=10897): stderr: | 20221214105645074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105645074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105645075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105645075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105645076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105645076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105645076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:46.726199 run osmo-stp_10.42.42.5(pid=10897): stdout: | (launched: 2022-12-14_10:56:44.886836) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:46.865592 run osmo-stp_10.42.42.5(pid=10897): stderr: | 20221214105645074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105645074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105645075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105645075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105645076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105645076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105645076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:47.028327 run patchelf(pid=10900): Terminating (SIGINT) 10:56:47.217191 run patchelf(pid=10900): Terminated: ok {rc=0} 10:56:47.351236 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10897): Process ended prematurely: osmo-stp_10.42.42.5(pid=10897) [trial-2403↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10897)] [trial-2403↪gprs:nanobts+band-1900↪iperf3m4.py:8] 10:56:47.361963 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:56:47.391361 run osmo-hlr_10.42.42.2(pid=10894): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10894)] 10:56:47.442051 run osmo-hlr_10.42.42.2(pid=10894): stdout: | (launched: 2022-12-14_10:56:43.875119) 10:56:47.495019 run osmo-hlr_10.42.42.2(pid=10894): stderr: | 20221214105644068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105644069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105644069 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105644069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105644069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105644069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105644081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105644091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105644092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105644092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:47.548702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10883): Terminating (SIGTERM) 10:56:47.591312 run iperf3-srv_10.42.42.10(pid=10884): Terminating (SIGTERM) 10:56:47.634033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10885): Terminating (SIGTERM) 10:56:47.676479 run iperf3-srv_10.42.42.10(pid=10886): Terminating (SIGTERM) 10:56:47.718936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10887): Terminating (SIGTERM) 10:56:47.761694 run iperf3-srv_10.42.42.10(pid=10888): Terminating (SIGTERM) 10:56:47.803851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10889): Terminating (SIGTERM) 10:56:47.846335 run iperf3-srv_10.42.42.10(pid=10890): Terminating (SIGTERM) 10:56:47.888589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10893): Terminating (SIGTERM) 10:56:47.931024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10896): Terminating (SIGTERM) 10:56:47.973197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10899): Terminating (SIGTERM) 10:56:48.015657 --- ParallelTerminationStrategy: PID 10883 died... 10:56:48.035463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10883): Terminated: ok {rc=0} 10:56:48.082525 --- ParallelTerminationStrategy: PID 10884 died... 10:56:48.102354 run iperf3-srv_10.42.42.10(pid=10884): Terminated {rc=256} 10:56:48.149140 --- ParallelTerminationStrategy: PID 10885 died... 10:56:48.169058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10885): Terminated: ok {rc=0} 10:56:48.215700 --- ParallelTerminationStrategy: PID 10886 died... 10:56:48.235471 run iperf3-srv_10.42.42.10(pid=10886): Terminated {rc=256} 10:56:48.281985 --- ParallelTerminationStrategy: PID 10887 died... 10:56:48.302017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10887): Terminated: ok {rc=0} 10:56:48.348543 --- ParallelTerminationStrategy: PID 10888 died... 10:56:48.368319 run iperf3-srv_10.42.42.10(pid=10888): Terminated {rc=256} 10:56:48.414913 --- ParallelTerminationStrategy: PID 10889 died... 10:56:48.435099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10889): Terminated: ok {rc=0} 10:56:48.482007 --- ParallelTerminationStrategy: PID 10890 died... 10:56:48.501963 run iperf3-srv_10.42.42.10(pid=10890): Terminated {rc=256} 10:56:48.548854 --- ParallelTerminationStrategy: PID 10893 died... 10:56:48.569174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10893): Terminated: ok {rc=0} 10:56:48.615514 --- ParallelTerminationStrategy: PID 10896 died... 10:56:48.635301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10896): Terminated: ok {rc=0} 10:56:48.681704 --- ParallelTerminationStrategy: PID 10899 died... 10:56:48.701760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10899): Terminated: ok {rc=0} 10:56:48.790539 bus /gobi_4: Setting Powered False 10:56:49.890519 bus /gobi_4: Setting Powered False 10:56:51.006927 bus /gobi_1: Setting Powered False 10:56:52.106294 bus /gobi_1: Setting Powered False 10:56:53.222329 bus /gobi_0: Setting Powered False 10:56:54.320397 bus /gobi_0: Setting Powered False 10:56:55.436734 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 10:56:56.540210 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:56.552085 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:56:56.592751 tst ping.py: using LAC 40447 10:56:56.719496 tst ping.py: using RAC 157 10:56:56.843944 tst ping.py: using CellId 40447 10:56:56.969738 tst ping.py: using BVCI 40448 10:56:57.085348 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:57.096692 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:57.108057 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:57.119150 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:57.130207 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:57.141233 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:57.152472 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:56:57.163657 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:56:57.279662 tst ping.py:19: start network... 10:56:57.481466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:57.944923 run create_hlr_db(pid=10901): Launched 10:56:58.059530 bus /gobi_6: Setting Powered False 10:56:59.119189 run create_hlr_db(pid=10901): Terminated: ok {rc=0} 10:56:59.559563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10903): Launched 10:56:59.882135 run osmo-hlr_10.42.42.2(pid=10904): Launched 10:57:00.003374 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:00.557574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10906): Launched 10:57:00.883198 run osmo-stp_10.42.42.5(pid=10919): Launched 10:57:01.064634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:01.717836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10921): Launched 10:57:01.845105 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:02.109791 run patchelf(pid=10922): Launched 10:57:02.304275 run osmo-stp_10.42.42.5(pid=10919): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10919)] 10:57:02.441989 run osmo-stp_10.42.42.5(pid=10919): stdout: | (launched: 2022-12-14_10:57:00.820441) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:02.581591 run osmo-stp_10.42.42.5(pid=10919): stderr: | 20221214105701074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105701075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105701075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105701075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105701076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105701076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105701076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:02.719656 run osmo-stp_10.42.42.5(pid=10919): stdout: | (launched: 2022-12-14_10:57:00.820441) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:02.851206 run osmo-stp_10.42.42.5(pid=10919): stderr: | 20221214105701074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105701075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105701075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105701075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105701076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105701076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105701076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:03.007315 run patchelf(pid=10922): Terminating (SIGINT) 10:57:03.188400 run patchelf(pid=10922): Terminated: ok {rc=0} 10:57:03.319017 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10919): Process ended prematurely: osmo-stp_10.42.42.5(pid=10919) [trial-2403↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10919)] [trial-2403↪gprs:nanobts+band-1900↪ping.py:22] 10:57:03.328772 tst ping.py:22: Test FAILED (6.8 sec) 10:57:03.357514 run osmo-hlr_10.42.42.2(pid=10904): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10904)] 10:57:03.408829 run osmo-hlr_10.42.42.2(pid=10904): stdout: | (launched: 2022-12-14_10:56:59.823353) 10:57:03.462203 run osmo-hlr_10.42.42.2(pid=10904): stderr: | 20221214105700020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105700020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105700020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105700020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105700020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105700020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105700031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105700039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105700040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105700040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:03.516236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10903): Terminating (SIGTERM) 10:57:03.558979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10906): Terminating (SIGTERM) 10:57:03.601995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10921): Terminating (SIGTERM) 10:57:03.644554 --- ParallelTerminationStrategy: PID 10903 died... 10:57:03.665015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10903): Terminated: ok {rc=0} 10:57:03.712676 --- ParallelTerminationStrategy: PID 10906 died... 10:57:03.732799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10906): Terminated: ok {rc=0} 10:57:03.779605 --- ParallelTerminationStrategy: PID 10921 died... 10:57:03.799561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10921): Terminated: ok {rc=0} 10:57:03.888341 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 10:57:04.975721 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:57:04.987590 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:57:05.028582 tst ping_idle_ping.py: using LAC 40448 10:57:05.155925 tst ping_idle_ping.py: using RAC 158 10:57:05.281200 tst ping_idle_ping.py: using CellId 40448 10:57:05.406957 tst ping_idle_ping.py: using BVCI 40449 10:57:05.523535 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:57:05.534909 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:57:05.546099 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:57:05.557133 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:57:05.568329 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:57:05.579345 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:57:05.591016 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:57:05.602139 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:57:05.718790 tst ping_idle_ping.py:24: start network... 10:57:05.921372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:06.390986 run create_hlr_db(pid=10923): Launched 10:57:06.506454 bus /gobi_6: Setting Powered False 10:57:07.566824 run create_hlr_db(pid=10923): Terminated: ok {rc=0} 10:57:08.007904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10925): Launched 10:57:08.331171 run osmo-hlr_10.42.42.2(pid=10926): Launched 10:57:08.455174 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:09.013583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10928): Launched 10:57:09.335783 run osmo-stp_10.42.42.5(pid=10929): Launched 10:57:09.458396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:10.013003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10931): Launched 10:57:10.137970 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:10.409775 run patchelf(pid=10932): Launched 10:57:10.590483 run osmo-stp_10.42.42.5(pid=10929): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10929)] 10:57:10.728176 run osmo-stp_10.42.42.5(pid=10929): stdout: | (launched: 2022-12-14_10:57:09.276344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:10.867208 run osmo-stp_10.42.42.5(pid=10929): stderr: | 20221214105709469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105709469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105709469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105709470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105709470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105709470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105709470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:11.006221 run osmo-stp_10.42.42.5(pid=10929): stdout: | (launched: 2022-12-14_10:57:09.276344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:11.138422 run osmo-stp_10.42.42.5(pid=10929): stderr: | 20221214105709469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105709469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105709469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105709470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105709470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105709470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105709470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:11.294576 run patchelf(pid=10932): Terminating (SIGINT) 10:57:11.475331 run patchelf(pid=10932): Terminated: ok {rc=0} 10:57:11.606527 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10929): Process ended prematurely: osmo-stp_10.42.42.5(pid=10929) [trial-2403↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10929)] [trial-2403↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 10:57:11.616179 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:57:11.644625 run osmo-hlr_10.42.42.2(pid=10926): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10926)] 10:57:11.694989 run osmo-hlr_10.42.42.2(pid=10926): stdout: | (launched: 2022-12-14_10:57:08.272158) 10:57:11.747288 run osmo-hlr_10.42.42.2(pid=10926): stderr: | 20221214105708466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105708466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105708466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105708466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105708466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105708466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105708478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105708487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105708487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105708487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:11.799925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10925): Terminating (SIGTERM) 10:57:11.842348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10928): Terminating (SIGTERM) 10:57:11.884671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10931): Terminating (SIGTERM) 10:57:11.927412 --- ParallelTerminationStrategy: PID 10925 died... 10:57:11.948025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10925): Terminated: ok {rc=0} 10:57:11.994784 --- ParallelTerminationStrategy: PID 10928 died... 10:57:12.014872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10928): Terminated: ok {rc=0} 10:57:12.061308 --- ParallelTerminationStrategy: PID 10931 died... 10:57:12.081258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10931): Terminated: ok {rc=0} 10:57:12.169970 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 10:57:13.469734 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:57:13.476459 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:57:13.500709 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:57:13.540547 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:57:13.629189 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:57:13.653449 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:57:13.692387 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:57:14.289599 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:57:14.341848 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:14.353242 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:57:14.394370 tst cs_paging_gprs_active.py: using LAC 40449 10:57:14.524326 tst cs_paging_gprs_active.py: using RAC 159 10:57:14.652627 tst cs_paging_gprs_active.py: using CellId 40449 10:57:14.780658 tst cs_paging_gprs_active.py: using BVCI 40450 10:57:14.899371 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:14.910982 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:14.922244 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:14.933524 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:14.945238 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:14.956782 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:14.968685 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:14.980285 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:14.992192 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:57:15.111742 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:57:15.232645 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:57:15.453416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:15.783448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10936): Launched 10:57:16.088116 run iperf3-srv_10.42.42.10(pid=10937): Launched 10:57:16.211235 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:57:16.423915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:16.744285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10938): Launched 10:57:17.038384 run iperf3-srv_10.42.42.10(pid=10939): Launched 10:57:17.170940 tst cs_paging_gprs_active.py:38: start network... 10:57:17.378823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:17.854481 run create_hlr_db(pid=10940): Launched 10:57:17.973160 bus /gobi_6: Setting Powered False 10:57:19.034079 run create_hlr_db(pid=10940): Terminated: ok {rc=0} 10:57:19.462544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10942): Launched 10:57:19.770830 run osmo-hlr_10.42.42.2(pid=10943): Launched 10:57:19.887849 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:20.429710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10945): Launched 10:57:20.736227 run osmo-stp_10.42.42.5(pid=10946): Launched 10:57:20.853132 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:21.380420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10948): Launched 10:57:21.498222 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:21.757253 run patchelf(pid=10949): Launched 10:57:21.928404 run osmo-stp_10.42.42.5(pid=10946): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10946)] 10:57:22.059449 run osmo-stp_10.42.42.5(pid=10946): stdout: | (launched: 2022-12-14_10:57:20.679387) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:22.191412 run osmo-stp_10.42.42.5(pid=10946): stderr: | 20221214105720847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105720848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105720848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105720848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105720849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105720849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105720849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:22.323652 run osmo-stp_10.42.42.5(pid=10946): stdout: | (launched: 2022-12-14_10:57:20.679387) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:22.449431 run osmo-stp_10.42.42.5(pid=10946): stderr: | 20221214105720847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105720848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105720848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105720848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105720849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105720849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105720849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:22.598143 run patchelf(pid=10949): Terminating (SIGINT) 10:57:22.771546 run patchelf(pid=10949): Terminated: ok {rc=0} 10:57:22.896048 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10946): Process ended prematurely: osmo-stp_10.42.42.5(pid=10946) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10946)] [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:57:22.905935 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:57:22.933453 run osmo-hlr_10.42.42.2(pid=10943): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10943)] 10:57:22.981894 run osmo-hlr_10.42.42.2(pid=10943): stdout: | (launched: 2022-12-14_10:57:19.712875) 10:57:23.031840 run osmo-hlr_10.42.42.2(pid=10943): stderr: | 20221214105719885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105719886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105719886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105719886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105719886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105719886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105719901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105719911 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105719911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105719911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:23.082216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10936): Terminating (SIGTERM) 10:57:23.122639 run iperf3-srv_10.42.42.10(pid=10937): Terminating (SIGTERM) 10:57:23.162902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10938): Terminating (SIGTERM) 10:57:23.203189 run iperf3-srv_10.42.42.10(pid=10939): Terminating (SIGTERM) 10:57:23.243277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10942): Terminating (SIGTERM) 10:57:23.283913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10945): Terminating (SIGTERM) 10:57:23.323948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10948): Terminating (SIGTERM) 10:57:23.364334 --- ParallelTerminationStrategy: PID 10936 died... 10:57:23.383950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10936): Terminated: ok {rc=0} 10:57:23.428294 --- ParallelTerminationStrategy: PID 10937 died... 10:57:23.447426 run iperf3-srv_10.42.42.10(pid=10937): Terminated {rc=256} 10:57:23.491632 --- ParallelTerminationStrategy: PID 10938 died... 10:57:23.510892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10938): Terminated: ok {rc=0} 10:57:23.555169 --- ParallelTerminationStrategy: PID 10939 died... 10:57:23.574231 run iperf3-srv_10.42.42.10(pid=10939): Terminated {rc=256} 10:57:23.618143 --- ParallelTerminationStrategy: PID 10942 died... 10:57:23.637192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10942): Terminated: ok {rc=0} 10:57:23.681291 --- ParallelTerminationStrategy: PID 10945 died... 10:57:23.700576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10945): Terminated: ok {rc=0} 10:57:23.744739 --- ParallelTerminationStrategy: PID 10948 died... 10:57:23.763821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10948): Terminated: ok {rc=0} 10:57:23.848514 bus /gobi_0: Setting Powered False 10:57:24.948195 bus /gobi_0: Setting Powered False 10:57:26.068320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:57:27.216342 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:27.227981 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:57:27.271054 tst iperf3.py: using LAC 40450 10:57:27.392021 tst iperf3.py: using RAC 160 10:57:27.513329 tst iperf3.py: using CellId 40450 10:57:27.634775 tst iperf3.py: using BVCI 40451 10:57:27.748138 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:27.759139 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:27.769964 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:27.780615 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:27.791705 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:27.802729 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:27.814003 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:27.824871 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:27.836084 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:57:27.953018 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:57:28.175377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:28.505491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10950): Launched 10:57:28.794660 run iperf3-srv_10.42.42.10(pid=10951): Launched 10:57:28.919388 tst iperf3.py:8: start network... 10:57:29.139449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:29.648702 run create_hlr_db(pid=10952): Launched 10:57:29.783361 bus /gobi_6: Setting Powered False 10:57:30.852785 run create_hlr_db(pid=10952): Terminated: ok {rc=0} 10:57:31.322430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10954): Launched 10:57:31.656377 run osmo-hlr_10.42.42.2(pid=10955): Launched 10:57:31.932250 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:32.520818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10957): Launched 10:57:32.828904 run osmo-stp_10.42.42.5(pid=10958): Launched 10:57:32.946548 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:33.475184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10960): Launched 10:57:33.593913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:33.852018 run patchelf(pid=10961): Launched 10:57:34.023556 run osmo-stp_10.42.42.5(pid=10958): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10958)] 10:57:34.153635 run osmo-stp_10.42.42.5(pid=10958): stdout: | (launched: 2022-12-14_10:57:32.771722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:34.285278 run osmo-stp_10.42.42.5(pid=10958): stderr: | 20221214105732941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105732941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105732941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105732942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105732942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105732942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105732943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:34.417097 run osmo-stp_10.42.42.5(pid=10958): stdout: | (launched: 2022-12-14_10:57:32.771722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:34.542569 run osmo-stp_10.42.42.5(pid=10958): stderr: | 20221214105732941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105732941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105732941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105732942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105732942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105732942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105732943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:34.691005 run patchelf(pid=10961): Terminating (SIGINT) 10:57:34.863399 run patchelf(pid=10961): Terminated: ok {rc=0} 10:57:34.987812 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10958): Process ended prematurely: osmo-stp_10.42.42.5(pid=10958) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10958)] [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 10:57:34.997588 tst iperf3.py:8: Test FAILED (7.8 sec) 10:57:35.024809 run osmo-hlr_10.42.42.2(pid=10955): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10955)] 10:57:35.073332 run osmo-hlr_10.42.42.2(pid=10955): stdout: | (launched: 2022-12-14_10:57:31.596940) 10:57:35.123248 run osmo-hlr_10.42.42.2(pid=10955): stderr: | 20221214105731828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105731828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105731829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105731829 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105731829 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105731830 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105731849 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105731863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105731864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105731864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:35.173667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10950): Terminating (SIGTERM) 10:57:35.213843 run iperf3-srv_10.42.42.10(pid=10951): Terminating (SIGTERM) 10:57:35.254147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10954): Terminating (SIGTERM) 10:57:35.294475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10957): Terminating (SIGTERM) 10:57:35.334670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10960): Terminating (SIGTERM) 10:57:35.375193 --- ParallelTerminationStrategy: PID 10950 died... 10:57:35.395082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10950): Terminated: ok {rc=0} 10:57:35.439427 --- ParallelTerminationStrategy: PID 10951 died... 10:57:35.458566 run iperf3-srv_10.42.42.10(pid=10951): Terminated {rc=256} 10:57:35.502714 --- ParallelTerminationStrategy: PID 10954 died... 10:57:35.521865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10954): Terminated: ok {rc=0} 10:57:35.566191 --- ParallelTerminationStrategy: PID 10957 died... 10:57:35.585132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10957): Terminated: ok {rc=0} 10:57:35.629201 --- ParallelTerminationStrategy: PID 10960 died... 10:57:35.648072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10960): Terminated: ok {rc=0} 10:57:35.734665 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:57:36.884272 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:36.896234 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:57:36.937284 tst iperf3m4.py: using LAC 40451 10:57:37.058751 tst iperf3m4.py: using RAC 161 10:57:37.180533 tst iperf3m4.py: using CellId 40451 10:57:37.300407 tst iperf3m4.py: using BVCI 40452 10:57:37.412461 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:37.423563 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:37.434421 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:37.445270 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:37.456206 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:37.467292 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:37.478743 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:37.489918 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:37.501170 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:57:37.623215 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:57:37.742887 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:57:37.866201 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:57:37.988401 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:57:38.209811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:38.539765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10962): Launched 10:57:38.827957 run iperf3-srv_10.42.42.10(pid=10963): Launched 10:57:38.952553 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:57:39.172669 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:39.501700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10964): Launched 10:57:39.789300 run iperf3-srv_10.42.42.10(pid=10965): Launched 10:57:39.913212 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:57:40.123920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:40.433487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10966): Launched 10:57:40.702307 run iperf3-srv_10.42.42.10(pid=10967): Launched 10:57:40.817704 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:57:41.022772 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:41.331102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10968): Launched 10:57:41.601244 run iperf3-srv_10.42.42.10(pid=10969): Launched 10:57:41.716127 tst iperf3m4.py:8: start network... 10:57:41.921266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:42.395877 run create_hlr_db(pid=10970): Launched 10:57:42.512709 bus /gobi_6: Setting Powered False 10:57:43.574416 run create_hlr_db(pid=10970): Terminated: ok {rc=0} 10:57:44.003203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10972): Launched 10:57:44.312894 run osmo-hlr_10.42.42.2(pid=10973): Launched 10:57:44.430934 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:44.958084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10975): Launched 10:57:45.267232 run osmo-stp_10.42.42.5(pid=10976): Launched 10:57:45.384756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:45.916848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10978): Launched 10:57:46.049709 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:46.315521 run patchelf(pid=10979): Launched 10:57:46.504872 run osmo-stp_10.42.42.5(pid=10976): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10976)] 10:57:46.638476 run osmo-stp_10.42.42.5(pid=10976): stdout: | (launched: 2022-12-14_10:57:45.210551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:46.773523 run osmo-stp_10.42.42.5(pid=10976): stderr: | 20221214105745378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105745378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105745378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105745379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105745379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105745379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105745379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:46.908876 run osmo-stp_10.42.42.5(pid=10976): stdout: | (launched: 2022-12-14_10:57:45.210551) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:47.038374 run osmo-stp_10.42.42.5(pid=10976): stderr: | 20221214105745378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105745378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105745378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105745379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105745379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105745379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105745379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:47.191175 run patchelf(pid=10979): Terminating (SIGINT) 10:57:47.366793 run patchelf(pid=10979): Terminated: ok {rc=0} 10:57:47.492259 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10976): Process ended prematurely: osmo-stp_10.42.42.5(pid=10976) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10976)] [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 10:57:47.502344 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:57:47.530232 run osmo-hlr_10.42.42.2(pid=10973): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10973)] 10:57:47.578865 run osmo-hlr_10.42.42.2(pid=10973): stdout: | (launched: 2022-12-14_10:57:44.255898) 10:57:47.629373 run osmo-hlr_10.42.42.2(pid=10973): stderr: | 20221214105744430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105744430 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105744430 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105744430 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105744430 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105744430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105744442 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105744451 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105744451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105744451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:47.679846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10962): Terminating (SIGTERM) 10:57:47.720250 run iperf3-srv_10.42.42.10(pid=10963): Terminating (SIGTERM) 10:57:47.760553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10964): Terminating (SIGTERM) 10:57:47.801041 run iperf3-srv_10.42.42.10(pid=10965): Terminating (SIGTERM) 10:57:47.841432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10966): Terminating (SIGTERM) 10:57:47.881871 run iperf3-srv_10.42.42.10(pid=10967): Terminating (SIGTERM) 10:57:47.922083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10968): Terminating (SIGTERM) 10:57:47.962410 run iperf3-srv_10.42.42.10(pid=10969): Terminating (SIGTERM) 10:57:48.002640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10972): Terminating (SIGTERM) 10:57:48.043057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10975): Terminating (SIGTERM) 10:57:48.083263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10978): Terminating (SIGTERM) 10:57:48.123977 --- ParallelTerminationStrategy: PID 10962 died... 10:57:48.144010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10962): Terminated: ok {rc=0} 10:57:48.189091 --- ParallelTerminationStrategy: PID 10963 died... 10:57:48.208311 run iperf3-srv_10.42.42.10(pid=10963): Terminated {rc=256} 10:57:48.252824 --- ParallelTerminationStrategy: PID 10964 died... 10:57:48.272706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10964): Terminated: ok {rc=0} 10:57:48.317202 --- ParallelTerminationStrategy: PID 10965 died... 10:57:48.336273 run iperf3-srv_10.42.42.10(pid=10965): Terminated {rc=256} 10:57:48.380829 --- ParallelTerminationStrategy: PID 10966 died... 10:57:48.400655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10966): Terminated: ok {rc=0} 10:57:48.445081 --- ParallelTerminationStrategy: PID 10967 died... 10:57:48.464180 run iperf3-srv_10.42.42.10(pid=10967): Terminated {rc=256} 10:57:48.508719 --- ParallelTerminationStrategy: PID 10968 died... 10:57:48.528064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10968): Terminated: ok {rc=0} 10:57:48.572555 --- ParallelTerminationStrategy: PID 10969 died... 10:57:48.591809 run iperf3-srv_10.42.42.10(pid=10969): Terminated {rc=256} 10:57:48.636168 --- ParallelTerminationStrategy: PID 10972 died... 10:57:48.655324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10972): Terminated: ok {rc=0} 10:57:48.699927 --- ParallelTerminationStrategy: PID 10975 died... 10:57:48.719234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10975): Terminated: ok {rc=0} 10:57:48.763835 --- ParallelTerminationStrategy: PID 10978 died... 10:57:48.783205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10978): Terminated: ok {rc=0} 10:57:48.868062 bus /gobi_4: Setting Powered False 10:57:49.967115 bus /gobi_4: Setting Powered False 10:57:51.084182 bus /gobi_1: Setting Powered False 10:57:52.183387 bus /gobi_1: Setting Powered False 10:57:53.300166 bus /gobi_0: Setting Powered False 10:57:54.399181 bus /gobi_0: Setting Powered False 10:57:55.516932 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 10:57:56.619574 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:56.631097 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:57:56.674571 tst ping.py: using LAC 40452 10:57:56.794853 tst ping.py: using RAC 162 10:57:56.913275 tst ping.py: using CellId 40452 10:57:57.029270 tst ping.py: using BVCI 40453 10:57:57.138093 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:57.149193 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:57.160178 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:57.171233 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:57.182419 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:57.193648 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:57.204798 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:57:57.216085 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:57:57.332559 tst ping.py:19: start network... 10:57:57.533444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:57.996373 run create_hlr_db(pid=10980): Launched 10:57:58.110864 bus /gobi_6: Setting Powered False 10:57:59.171457 run create_hlr_db(pid=10980): Terminated: ok {rc=0} 10:57:59.592295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10982): Launched 10:57:59.893154 run osmo-hlr_10.42.42.2(pid=10983): Launched 10:58:00.007365 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:00.539348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10985): Launched 10:58:00.849467 run osmo-stp_10.42.42.5(pid=10986): Launched 10:58:01.022872 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:58:01.785794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10988): Launched 10:58:01.923734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:58:02.203091 run patchelf(pid=10989): Launched 10:58:02.396803 run osmo-stp_10.42.42.5(pid=10986): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10986)] 10:58:02.533480 run osmo-stp_10.42.42.5(pid=10986): stdout: | (launched: 2022-12-14_10:58:00.785826) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:02.672839 run osmo-stp_10.42.42.5(pid=10986): stderr: | 20221214105801090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105801090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105801091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105801092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105801093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105801094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105801094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:02.811376 run osmo-stp_10.42.42.5(pid=10986): stdout: | (launched: 2022-12-14_10:58:00.785826) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:02.943491 run osmo-stp_10.42.42.5(pid=10986): stderr: | 20221214105801090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105801090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105801091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105801092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105801093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105801094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105801094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:03.100437 run patchelf(pid=10989): Terminating (SIGINT) 10:58:03.281291 run patchelf(pid=10989): Terminated: ok {rc=0} 10:58:03.411969 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10986): Process ended prematurely: osmo-stp_10.42.42.5(pid=10986) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10986)] [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 10:58:03.421986 tst ping.py:22: Test FAILED (6.8 sec) 10:58:03.450849 run osmo-hlr_10.42.42.2(pid=10983): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10983)] 10:58:03.501836 run osmo-hlr_10.42.42.2(pid=10983): stdout: | (launched: 2022-12-14_10:57:59.837451) 10:58:03.555164 run osmo-hlr_10.42.42.2(pid=10983): stderr: | 20221214105800012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105800012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105800012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105800012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105800012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105800012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105800024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105800032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105800032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105800032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:03.608726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10982): Terminating (SIGTERM) 10:58:03.651221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10985): Terminating (SIGTERM) 10:58:03.694436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10988): Terminating (SIGTERM) 10:58:03.737460 --- ParallelTerminationStrategy: PID 10982 died... 10:58:03.758229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10982): Terminated: ok {rc=0} 10:58:03.805702 --- ParallelTerminationStrategy: PID 10985 died... 10:58:03.825955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10985): Terminated: ok {rc=0} 10:58:03.872937 --- ParallelTerminationStrategy: PID 10988 died... 10:58:03.893111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10988): Terminated: ok {rc=0} 10:58:03.982537 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:58:05.071929 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:05.083926 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:58:05.126092 tst ping_idle_ping.py: using LAC 40453 10:58:05.244758 tst ping_idle_ping.py: using RAC 163 10:58:05.365745 tst ping_idle_ping.py: using CellId 40453 10:58:05.483038 tst ping_idle_ping.py: using BVCI 40454 10:58:05.591386 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:05.602520 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:05.613464 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:05.624268 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:05.635331 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:05.646464 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:05.658203 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:05.669641 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:58:05.791718 tst ping_idle_ping.py:24: start network... 10:58:06.008778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:06.515308 run create_hlr_db(pid=10990): Launched 10:58:06.647829 bus /gobi_6: Setting Powered False 10:58:07.712749 run create_hlr_db(pid=10990): Terminated: ok {rc=0} 10:58:08.164712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10992): Launched 10:58:08.486775 run osmo-hlr_10.42.42.2(pid=10993): Launched 10:58:08.612064 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:09.171907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10995): Launched 10:58:09.493716 run osmo-stp_10.42.42.5(pid=10996): Launched 10:58:09.618665 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:58:10.171968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10998): Launched 10:58:10.295096 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:58:10.567097 run patchelf(pid=10999): Launched 10:58:10.748376 run osmo-stp_10.42.42.5(pid=10996): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10996)] 10:58:10.884725 run osmo-stp_10.42.42.5(pid=10996): stdout: | (launched: 2022-12-14_10:58:09.434579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:11.022954 run osmo-stp_10.42.42.5(pid=10996): stderr: | 20221214105809625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105809625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105809625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105809625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105809626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105809626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105809626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:11.161457 run osmo-stp_10.42.42.5(pid=10996): stdout: | (launched: 2022-12-14_10:58:09.434579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:11.292894 run osmo-stp_10.42.42.5(pid=10996): stderr: | 20221214105809625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105809625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105809625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105809625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105809626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105809626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105809626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:11.448769 run patchelf(pid=10999): Terminating (SIGINT) 10:58:11.629810 run patchelf(pid=10999): Terminated: ok {rc=0} 10:58:11.760119 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10996): Process ended prematurely: osmo-stp_10.42.42.5(pid=10996) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10996)] [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 10:58:11.769863 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:58:11.798436 run osmo-hlr_10.42.42.2(pid=10993): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10993)] 10:58:11.849183 run osmo-hlr_10.42.42.2(pid=10993): stdout: | (launched: 2022-12-14_10:58:08.427389) 10:58:11.901731 run osmo-hlr_10.42.42.2(pid=10993): stderr: | 20221214105808622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105808622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105808622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105808622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105808623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105808623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105808636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105808646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105808646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105808646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:11.954496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10992): Terminating (SIGTERM) 10:58:11.996806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10995): Terminating (SIGTERM) 10:58:12.039093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10998): Terminating (SIGTERM) 10:58:12.082238 --- ParallelTerminationStrategy: PID 10992 died... 10:58:12.102691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10992): Terminated: ok {rc=0} 10:58:12.149972 --- ParallelTerminationStrategy: PID 10995 died... 10:58:12.169757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10995): Terminated: ok {rc=0} 10:58:12.216502 --- ParallelTerminationStrategy: PID 10998 died... 10:58:12.236428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10998): Terminated: ok {rc=0} 10:58:12.324794 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:58:13.626878 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:58:13.634488 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:58:13.658806 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:58:13.698292 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:58:13.786771 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:58:13.810929 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:58:13.849908 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:58:14.448201 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:58:14.500519 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:14.512045 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:58:14.573419 tst cs_paging_gprs_active.py: using LAC 40454 10:58:14.702411 tst cs_paging_gprs_active.py: using RAC 164 10:58:14.829544 tst cs_paging_gprs_active.py: using CellId 40454 10:58:14.959315 tst cs_paging_gprs_active.py: using BVCI 40455 10:58:15.079762 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:15.091278 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:15.102542 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:15.114008 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:15.125338 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:15.137089 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:15.148463 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:15.159768 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:15.171207 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:58:15.289731 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:58:15.411388 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:58:15.632629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:15.966069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11007): Launched 10:58:16.273657 run iperf3-srv_10.42.42.10(pid=11008): Launched 10:58:16.411896 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:58:16.637174 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:16.972899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11009): Launched 10:58:17.273037 run iperf3-srv_10.42.42.10(pid=11010): Launched 10:58:17.395426 tst cs_paging_gprs_active.py:38: start network... 10:58:17.615188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:18.121426 run create_hlr_db(pid=11011): Launched 10:58:18.254686 bus /gobi_6: Setting Powered False 10:58:19.318948 run create_hlr_db(pid=11011): Terminated: ok {rc=0} 10:58:19.757537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11013): Launched 10:58:20.064913 run osmo-hlr_10.42.42.2(pid=11014): Launched 10:58:20.182322 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:20.717827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11016): Launched 10:58:21.024382 run osmo-stp_10.42.42.5(pid=11018): Launched 10:58:21.141501 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:58:21.671006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11020): Launched 10:58:21.790832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:58:22.050142 run patchelf(pid=11021): Launched 10:58:22.220874 run osmo-stp_10.42.42.5(pid=11018): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11018)] 10:58:22.351419 run osmo-stp_10.42.42.5(pid=11018): stdout: | (launched: 2022-12-14_10:58:20.966849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:22.483321 run osmo-stp_10.42.42.5(pid=11018): stderr: | 20221214105821134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105821134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105821134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105821135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105821135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105821135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105821135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:22.614585 run osmo-stp_10.42.42.5(pid=11018): stdout: | (launched: 2022-12-14_10:58:20.966849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:22.739635 run osmo-stp_10.42.42.5(pid=11018): stderr: | 20221214105821134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105821134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105821134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105821135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105821135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105821135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105821135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:22.887976 run patchelf(pid=11021): Terminating (SIGINT) 10:58:23.060719 run patchelf(pid=11021): Terminated: ok {rc=0} 10:58:23.185225 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11018): Process ended prematurely: osmo-stp_10.42.42.5(pid=11018) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11018)] [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:58:23.195061 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:58:23.222770 run osmo-hlr_10.42.42.2(pid=11014): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11014)] 10:58:23.271612 run osmo-hlr_10.42.42.2(pid=11014): stdout: | (launched: 2022-12-14_10:58:20.008235) 10:58:23.321526 run osmo-hlr_10.42.42.2(pid=11014): stderr: | 20221214105820181 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105820181 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105820181 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105820181 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105820182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105820182 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105820197 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105820205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105820206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105820206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:23.372003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11007): Terminating (SIGTERM) 10:58:23.412451 run iperf3-srv_10.42.42.10(pid=11008): Terminating (SIGTERM) 10:58:23.452707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11009): Terminating (SIGTERM) 10:58:23.493159 run iperf3-srv_10.42.42.10(pid=11010): Terminating (SIGTERM) 10:58:23.533355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11013): Terminating (SIGTERM) 10:58:23.573866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11016): Terminating (SIGTERM) 10:58:23.614205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11020): Terminating (SIGTERM) 10:58:23.654613 --- ParallelTerminationStrategy: PID 11007 died... 10:58:23.674413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11007): Terminated: ok {rc=0} 10:58:23.718879 --- ParallelTerminationStrategy: PID 11008 died... 10:58:23.737842 run iperf3-srv_10.42.42.10(pid=11008): Terminated {rc=256} 10:58:23.781897 --- ParallelTerminationStrategy: PID 11009 died... 10:58:23.800670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11009): Terminated: ok {rc=0} 10:58:23.844739 --- ParallelTerminationStrategy: PID 11010 died... 10:58:23.863809 run iperf3-srv_10.42.42.10(pid=11010): Terminated {rc=256} 10:58:23.907680 --- ParallelTerminationStrategy: PID 11013 died... 10:58:23.926567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11013): Terminated: ok {rc=0} 10:58:23.970402 --- ParallelTerminationStrategy: PID 11016 died... 10:58:23.989572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11016): Terminated: ok {rc=0} 10:58:24.033459 --- ParallelTerminationStrategy: PID 11020 died... 10:58:24.052431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11020): Terminated: ok {rc=0} 10:58:24.137217 bus /gobi_0: Setting Powered False 10:58:25.236563 bus /gobi_0: Setting Powered False 10:58:26.355829 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:58:27.503090 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:27.514786 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:58:27.577683 tst iperf3.py: using LAC 40455 10:58:27.697810 tst iperf3.py: using RAC 165 10:58:27.818814 tst iperf3.py: using CellId 40455 10:58:27.939979 tst iperf3.py: using BVCI 40456 10:58:28.052134 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:28.063238 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:28.074139 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:28.084866 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:28.095950 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:28.107213 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:28.118448 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:28.129524 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:28.140614 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:58:28.256903 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:58:28.462289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:28.770554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11022): Launched 10:58:29.038391 run iperf3-srv_10.42.42.10(pid=11023): Launched 10:58:29.155253 tst iperf3.py:8: start network... 10:58:29.360281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:29.833711 run create_hlr_db(pid=11024): Launched 10:58:29.949941 bus /gobi_6: Setting Powered False 10:58:31.026794 run create_hlr_db(pid=11024): Terminated: ok {rc=0} 10:58:31.507602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11026): Launched 10:58:31.857763 run osmo-hlr_10.42.42.2(pid=11027): Launched 10:58:32.117967 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:32.643663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11029): Launched 10:58:32.950584 run osmo-stp_10.42.42.5(pid=11030): Launched 10:58:33.069502 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:58:33.596380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11032): Launched 10:58:33.714182 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:58:33.972140 run patchelf(pid=11033): Launched 10:58:34.144428 run osmo-stp_10.42.42.5(pid=11030): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11030)] 10:58:34.273658 run osmo-stp_10.42.42.5(pid=11030): stdout: | (launched: 2022-12-14_10:58:32.893604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:34.404538 run osmo-stp_10.42.42.5(pid=11030): stderr: | 20221214105833061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105833061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105833062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105833062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105833063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105833063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105833063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:34.535323 run osmo-stp_10.42.42.5(pid=11030): stdout: | (launched: 2022-12-14_10:58:32.893604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:34.660170 run osmo-stp_10.42.42.5(pid=11030): stderr: | 20221214105833061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105833061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105833062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105833062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105833063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105833063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105833063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:34.808189 run patchelf(pid=11033): Terminating (SIGINT) 10:58:34.980254 run patchelf(pid=11033): Terminated: ok {rc=0} 10:58:35.104398 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11030): Process ended prematurely: osmo-stp_10.42.42.5(pid=11030) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11030)] [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 10:58:35.114756 tst iperf3.py:8: Test FAILED (7.6 sec) 10:58:35.142059 run osmo-hlr_10.42.42.2(pid=11027): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11027)] 10:58:35.190237 run osmo-hlr_10.42.42.2(pid=11027): stdout: | (launched: 2022-12-14_10:58:31.795641) 10:58:35.239751 run osmo-hlr_10.42.42.2(pid=11027): stderr: | 20221214105832067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105832067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105832067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105832067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105832067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105832067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105832087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105832105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105832105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105832105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:35.289862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11022): Terminating (SIGTERM) 10:58:35.330302 run iperf3-srv_10.42.42.10(pid=11023): Terminating (SIGTERM) 10:58:35.370475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11026): Terminating (SIGTERM) 10:58:35.410725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11029): Terminating (SIGTERM) 10:58:35.451185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11032): Terminating (SIGTERM) 10:58:35.491513 --- ParallelTerminationStrategy: PID 11022 died... 10:58:35.511164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11022): Terminated: ok {rc=0} 10:58:35.555410 --- ParallelTerminationStrategy: PID 11023 died... 10:58:35.574335 run iperf3-srv_10.42.42.10(pid=11023): Terminated {rc=256} 10:58:35.618241 --- ParallelTerminationStrategy: PID 11026 died... 10:58:35.637105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11026): Terminated: ok {rc=0} 10:58:35.681030 --- ParallelTerminationStrategy: PID 11029 died... 10:58:35.699932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11029): Terminated: ok {rc=0} 10:58:35.743947 --- ParallelTerminationStrategy: PID 11032 died... 10:58:35.762870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11032): Terminated: ok {rc=0} 10:58:35.849155 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:58:36.996934 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:37.008804 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:58:37.074792 tst iperf3m4.py: using LAC 40456 10:58:37.193785 tst iperf3m4.py: using RAC 166 10:58:37.312700 tst iperf3m4.py: using CellId 40456 10:58:37.430182 tst iperf3m4.py: using BVCI 40457 10:58:37.542172 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:37.553182 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:37.563947 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:37.574834 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:37.585905 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:37.597645 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:37.608934 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:37.620234 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:37.631751 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:58:37.749800 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:58:37.873190 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:58:37.994858 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:58:38.113522 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:58:38.319918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:38.628199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11034): Launched 10:58:38.896924 run iperf3-srv_10.42.42.10(pid=11035): Launched 10:58:39.012101 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:58:39.217121 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:39.525204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11036): Launched 10:58:39.791811 run iperf3-srv_10.42.42.10(pid=11037): Launched 10:58:39.906610 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:58:40.110843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:40.418165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11038): Launched 10:58:40.687483 run iperf3-srv_10.42.42.10(pid=11039): Launched 10:58:40.802429 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:58:41.006195 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:41.313491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11040): Launched 10:58:41.581560 run iperf3-srv_10.42.42.10(pid=11041): Launched 10:58:41.696663 tst iperf3m4.py:8: start network... 10:58:41.900681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:42.375068 run create_hlr_db(pid=11042): Launched 10:58:42.493129 bus /gobi_6: Setting Powered False 10:58:43.554025 run create_hlr_db(pid=11042): Terminated: ok {rc=0} 10:58:43.981491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11044): Launched 10:58:44.288655 run osmo-hlr_10.42.42.2(pid=11045): Launched 10:58:44.406268 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:44.936434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11047): Launched 10:58:45.243988 run osmo-stp_10.42.42.5(pid=11048): Launched 10:58:45.361759 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:58:45.891350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11050): Launched 10:58:46.036527 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:58:46.323480 run patchelf(pid=11051): Launched 10:58:46.558794 run osmo-stp_10.42.42.5(pid=11048): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11048)] 10:58:46.731359 run osmo-stp_10.42.42.5(pid=11048): stdout: | (launched: 2022-12-14_10:58:45.187526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:46.906661 run osmo-stp_10.42.42.5(pid=11048): stderr: | 20221214105845356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105845356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105845356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105845356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105845357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105845357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105845357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:47.065551 run osmo-stp_10.42.42.5(pid=11048): stdout: | (launched: 2022-12-14_10:58:45.187526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:47.204701 run osmo-stp_10.42.42.5(pid=11048): stderr: | 20221214105845356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105845356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105845356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105845356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105845357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105845357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105845357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:47.364651 run patchelf(pid=11051): Terminating (SIGINT) 10:58:47.549516 run patchelf(pid=11051): Terminated: ok {rc=0} 10:58:47.683311 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11048): Process ended prematurely: osmo-stp_10.42.42.5(pid=11048) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11048)] [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:58:47.694038 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:58:47.723400 run osmo-hlr_10.42.42.2(pid=11045): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11045)] 10:58:47.773777 run osmo-hlr_10.42.42.2(pid=11045): stdout: | (launched: 2022-12-14_10:58:44.231915) 10:58:47.825910 run osmo-hlr_10.42.42.2(pid=11045): stderr: | 20221214105844406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105844406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105844406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105844406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105844406 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105844406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105844418 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105844428 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105844429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105844429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:47.878387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11034): Terminating (SIGTERM) 10:58:47.920626 run iperf3-srv_10.42.42.10(pid=11035): Terminating (SIGTERM) 10:58:47.962922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11036): Terminating (SIGTERM) 10:58:48.005960 run iperf3-srv_10.42.42.10(pid=11037): Terminating (SIGTERM) 10:58:48.048245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11038): Terminating (SIGTERM) 10:58:48.090389 run iperf3-srv_10.42.42.10(pid=11039): Terminating (SIGTERM) 10:58:48.133302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11040): Terminating (SIGTERM) 10:58:48.175645 run iperf3-srv_10.42.42.10(pid=11041): Terminating (SIGTERM) 10:58:48.217619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11044): Terminating (SIGTERM) 10:58:48.259696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11047): Terminating (SIGTERM) 10:58:48.301910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11050): Terminating (SIGTERM) 10:58:48.344309 --- ParallelTerminationStrategy: PID 11034 died... 10:58:48.364165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11034): Terminated: ok {rc=0} 10:58:48.410739 --- ParallelTerminationStrategy: PID 11035 died... 10:58:48.430494 run iperf3-srv_10.42.42.10(pid=11035): Terminated {rc=256} 10:58:48.476693 --- ParallelTerminationStrategy: PID 11036 died... 10:58:48.496452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11036): Terminated: ok {rc=0} 10:58:48.542730 --- ParallelTerminationStrategy: PID 11037 died... 10:58:48.562546 run iperf3-srv_10.42.42.10(pid=11037): Terminated {rc=256} 10:58:48.609074 --- ParallelTerminationStrategy: PID 11038 died... 10:58:48.628892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11038): Terminated: ok {rc=0} 10:58:48.675165 --- ParallelTerminationStrategy: PID 11039 died... 10:58:48.694836 run iperf3-srv_10.42.42.10(pid=11039): Terminated {rc=256} 10:58:48.741129 --- ParallelTerminationStrategy: PID 11040 died... 10:58:48.761056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11040): Terminated: ok {rc=0} 10:58:48.807282 --- ParallelTerminationStrategy: PID 11041 died... 10:58:48.826974 run iperf3-srv_10.42.42.10(pid=11041): Terminated {rc=256} 10:58:48.873113 --- ParallelTerminationStrategy: PID 11044 died... 10:58:48.892705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11044): Terminated: ok {rc=0} 10:58:48.938927 --- ParallelTerminationStrategy: PID 11047 died... 10:58:48.958703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11047): Terminated: ok {rc=0} 10:58:49.004859 --- ParallelTerminationStrategy: PID 11050 died... 10:58:49.025082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11050): Terminated: ok {rc=0} 10:58:49.113401 bus /gobi_4: Setting Powered False 10:58:50.212662 bus /gobi_4: Setting Powered False 10:58:51.328337 bus /gobi_1: Setting Powered False 10:58:52.427480 bus /gobi_1: Setting Powered False 10:58:53.544492 bus /gobi_0: Setting Powered False 10:58:54.644112 bus /gobi_0: Setting Powered False 10:58:55.761158 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:58:56.863796 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:56.876010 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:58:56.938055 tst ping.py: using LAC 40457 10:58:57.063218 tst ping.py: using RAC 167 10:58:57.189328 tst ping.py: using CellId 40457 10:58:57.316018 tst ping.py: using BVCI 40458 10:58:57.434068 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:57.445780 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:57.457414 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:57.468811 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:57.480204 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:57.491672 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:57.503261 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:58:57.514593 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:58:57.634060 tst ping.py:19: start network... 10:58:57.851045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:58.349492 run create_hlr_db(pid=11052): Launched 10:58:58.478928 bus /gobi_6: Setting Powered False 10:58:59.543218 run create_hlr_db(pid=11052): Terminated: ok {rc=0} 10:58:59.974863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11054): Launched 10:59:00.276033 run osmo-hlr_10.42.42.2(pid=11055): Launched 10:59:00.390764 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:00.965712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11057): Launched 10:59:01.278890 run osmo-stp_10.42.42.5(pid=11058): Launched 10:59:01.509411 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:59:02.310256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11060): Launched 10:59:02.442227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:59:02.713669 run patchelf(pid=11061): Launched 10:59:02.892706 run osmo-stp_10.42.42.5(pid=11058): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11058)] 10:59:03.027926 run osmo-stp_10.42.42.5(pid=11058): stdout: | (launched: 2022-12-14_10:59:01.222080) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:03.165772 run osmo-stp_10.42.42.5(pid=11058): stderr: | 20221214105901589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105901590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105901590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105901591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105901592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105901592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105901592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:03.303253 run osmo-stp_10.42.42.5(pid=11058): stdout: | (launched: 2022-12-14_10:59:01.222080) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:03.434697 run osmo-stp_10.42.42.5(pid=11058): stderr: | 20221214105901589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105901590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105901590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105901591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105901592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105901592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105901592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:03.590037 run patchelf(pid=11061): Terminating (SIGINT) 10:59:03.769796 run patchelf(pid=11061): Terminated: ok {rc=0} 10:59:03.899534 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11058): Process ended prematurely: osmo-stp_10.42.42.5(pid=11058) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11058)] [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 10:59:03.909336 tst ping.py:22: Test FAILED (7.0 sec) 10:59:03.937937 run osmo-hlr_10.42.42.2(pid=11055): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11055)] 10:59:03.988040 run osmo-hlr_10.42.42.2(pid=11055): stdout: | (launched: 2022-12-14_10:59:00.220294) 10:59:04.040241 run osmo-hlr_10.42.42.2(pid=11055): stderr: | 20221214105900393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105900393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105900393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105900393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105900393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105900393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105900405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105900414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105900415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105900415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:04.092847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11054): Terminating (SIGTERM) 10:59:04.134853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11057): Terminating (SIGTERM) 10:59:04.176875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11060): Terminating (SIGTERM) 10:59:04.219881 --- ParallelTerminationStrategy: PID 11054 died... 10:59:04.240127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11054): Terminated: ok {rc=0} 10:59:04.286702 --- ParallelTerminationStrategy: PID 11057 died... 10:59:04.306392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11057): Terminated: ok {rc=0} 10:59:04.352822 --- ParallelTerminationStrategy: PID 11060 died... 10:59:04.372826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11060): Terminated: ok {rc=0} 10:59:04.461263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:59:05.551012 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:05.563290 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:59:05.625681 tst ping_idle_ping.py: using LAC 40458 10:59:05.751951 tst ping_idle_ping.py: using RAC 168 10:59:05.871547 tst ping_idle_ping.py: using CellId 40458 10:59:05.990880 tst ping_idle_ping.py: using BVCI 40459 10:59:06.099499 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:06.110800 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:06.121889 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:06.133066 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:06.144287 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:06.155878 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:06.167074 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:06.178354 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:59:06.295226 tst ping_idle_ping.py:24: start network... 10:59:06.497505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:06.964918 run create_hlr_db(pid=11062): Launched 10:59:07.079883 bus /gobi_6: Setting Powered False 10:59:08.141480 run create_hlr_db(pid=11062): Terminated: ok {rc=0} 10:59:08.585480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11064): Launched 10:59:08.907802 run osmo-hlr_10.42.42.2(pid=11065): Launched 10:59:09.032015 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:09.593069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11067): Launched 10:59:09.916366 run osmo-stp_10.42.42.5(pid=11068): Launched 10:59:10.038864 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:59:10.591696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11070): Launched 10:59:10.716068 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:59:10.987457 run patchelf(pid=11071): Launched 10:59:11.167302 run osmo-stp_10.42.42.5(pid=11068): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11068)] 10:59:11.303355 run osmo-stp_10.42.42.5(pid=11068): stdout: | (launched: 2022-12-14_10:59:09.857636) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:11.441411 run osmo-stp_10.42.42.5(pid=11068): stderr: | 20221214105910048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105910048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105910048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105910049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105910049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105910049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105910049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:11.580053 run osmo-stp_10.42.42.5(pid=11068): stdout: | (launched: 2022-12-14_10:59:09.857636) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:11.711605 run osmo-stp_10.42.42.5(pid=11068): stderr: | 20221214105910048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105910048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105910048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105910049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105910049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105910049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105910049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:11.867533 run patchelf(pid=11071): Terminating (SIGINT) 10:59:12.048521 run patchelf(pid=11071): Terminated: ok {rc=0} 10:59:12.178696 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11068): Process ended prematurely: osmo-stp_10.42.42.5(pid=11068) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11068)] [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:59:12.188505 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:59:12.217128 run osmo-hlr_10.42.42.2(pid=11065): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11065)] 10:59:12.267576 run osmo-hlr_10.42.42.2(pid=11065): stdout: | (launched: 2022-12-14_10:59:08.848695) 10:59:12.319678 run osmo-hlr_10.42.42.2(pid=11065): stderr: | 20221214105909045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105909045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105909046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105909046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105909046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105909046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105909059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105909067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105909067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105909067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:12.372450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11064): Terminating (SIGTERM) 10:59:12.414672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11067): Terminating (SIGTERM) 10:59:12.457502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11070): Terminating (SIGTERM) 10:59:12.500000 --- ParallelTerminationStrategy: PID 11064 died... 10:59:12.520195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11064): Terminated: ok {rc=0} 10:59:12.566993 --- ParallelTerminationStrategy: PID 11067 died... 10:59:12.587060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11067): Terminated: ok {rc=0} 10:59:12.633409 --- ParallelTerminationStrategy: PID 11070 died... 10:59:12.653205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11070): Terminated: ok {rc=0} 10:59:12.741075 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 10:59:14.041541 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:59:14.049980 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:59:14.074275 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:59:14.109930 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:59:14.166329 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:59:14.190269 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:59:14.225393 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:59:14.787003 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:59:14.793508 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:59:14.806060 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:59:14.867782 tst switch_tch_pdch.py: using LAC 40459 10:59:14.992733 tst switch_tch_pdch.py: using RAC 169 10:59:15.117875 tst switch_tch_pdch.py: using CellId 40459 10:59:15.242581 tst switch_tch_pdch.py: using BVCI 40460 10:59:15.358654 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:59:15.370985 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:59:15.382915 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:59:15.394944 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:59:15.406911 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:59:15.418783 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:59:15.430835 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:59:15.442881 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:59:15.560224 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:59:15.681440 tst switch_tch_pdch.py:51: start network... 10:59:15.907972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:16.413877 run create_hlr_db(pid=11075): Launched 10:59:16.576082 bus /gobi_6: Setting Powered False 10:59:17.637408 run create_hlr_db(pid=11075): Terminated: ok {rc=0} 10:59:18.091397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11077): Launched 10:59:18.414138 run osmo-hlr_10.42.42.2(pid=11078): Launched 10:59:18.537690 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:19.097363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11080): Launched 10:59:19.418686 run osmo-stp_10.42.42.5(pid=11081): Launched 10:59:19.542464 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:59:20.096093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11083): Launched 10:59:20.219201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:59:20.490152 run patchelf(pid=11084): Launched 10:59:20.671162 run osmo-stp_10.42.42.5(pid=11081): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11081)] 10:59:20.807229 run osmo-stp_10.42.42.5(pid=11081): stdout: | (launched: 2022-12-14_10:59:19.359553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:20.945275 run osmo-stp_10.42.42.5(pid=11081): stderr: | 20221214105919550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105919550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105919550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105919551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105919551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105919551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105919551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:21.083293 run osmo-stp_10.42.42.5(pid=11081): stdout: | (launched: 2022-12-14_10:59:19.359553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:21.214607 run osmo-stp_10.42.42.5(pid=11081): stderr: | 20221214105919550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105919550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105919550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105919551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105919551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105919551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105919551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:21.370375 run patchelf(pid=11084): Terminating (SIGINT) 10:59:21.550210 run patchelf(pid=11084): Terminated: ok {rc=0} 10:59:21.681428 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11081): Process ended prematurely: osmo-stp_10.42.42.5(pid=11081) [trial-2403↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11081)] [trial-2403↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:59:21.691275 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 10:59:21.719883 run osmo-hlr_10.42.42.2(pid=11078): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11078)] 10:59:21.770531 run osmo-hlr_10.42.42.2(pid=11078): stdout: | (launched: 2022-12-14_10:59:18.355297) 10:59:21.822768 run osmo-hlr_10.42.42.2(pid=11078): stderr: | 20221214105918549 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105918549 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105918549 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105918549 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105918549 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105918549 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105918563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105918573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105918573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105918573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:21.875943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11077): Terminating (SIGTERM) 10:59:21.918315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11080): Terminating (SIGTERM) 10:59:21.960405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11083): Terminating (SIGTERM) 10:59:22.002876 --- ParallelTerminationStrategy: PID 11077 died... 10:59:22.023299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11077): Terminated: ok {rc=0} 10:59:22.070043 --- ParallelTerminationStrategy: PID 11080 died... 10:59:22.090314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11080): Terminated: ok {rc=0} 10:59:22.136836 --- ParallelTerminationStrategy: PID 11083 died... 10:59:22.157310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11083): Terminated: ok {rc=0} 10:59:22.245821 bus /gobi_0: Setting Powered False 10:59:23.347978 bus /gobi_0: Setting Powered False 10:59:24.466593 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 sms:nanobts+band-900 --------------------------------------------------------------------- 10:59:25.711935 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:59:25.717056 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 10:59:25.748643 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 10:59:25.776276 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 10:59:25.828848 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 10:59:25.860731 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 10:59:25.887497 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 10:59:26.433013 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 10:59:26.438287 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:26.449094 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 10:59:26.495399 tst mo_mt_sms.py: using LAC 40460 10:59:26.623509 tst mo_mt_sms.py: using RAC 170 10:59:26.750283 tst mo_mt_sms.py: using CellId 40460 10:59:26.876837 tst mo_mt_sms.py: using BVCI 40461 10:59:26.992100 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:27.003422 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:27.014492 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:27.025455 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:27.036375 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:27.047400 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 10:59:27.168725 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 10:59:27.285572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:27.751173 run create_hlr_db(pid=11088): Launched 10:59:27.867522 bus /gobi_6: Setting Powered False 10:59:28.931615 run create_hlr_db(pid=11088): Terminated: ok {rc=0} 10:59:29.364554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11090): Launched 10:59:29.665598 run osmo-hlr_10.42.42.2(pid=11091): Launched 10:59:29.782201 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:30.299158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11093): Launched 10:59:30.598811 run osmo-stp_10.42.42.5(pid=11094): Launched 10:59:30.714077 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:31.304174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11096): Launched 10:59:31.625569 run osmo-msc_10.42.42.6(pid=11097): Launched 10:59:31.942969 run osmo-stp_10.42.42.5(pid=11094): ERR: Terminated: ERROR {rc=1} [trial-2403↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11094)] 10:59:32.193781 run osmo-stp_10.42.42.5(pid=11094): stdout: | (launched: 2022-12-14_10:59:30.543104) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:32.343881 run osmo-stp_10.42.42.5(pid=11094): stderr: | 20221214105930708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105930709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105930709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105930709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105930710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105930710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105930710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:32.470567 run osmo-stp_10.42.42.5(pid=11094): stdout: | (launched: 2022-12-14_10:59:30.543104) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:32.590254 run osmo-stp_10.42.42.5(pid=11094): stderr: | 20221214105930708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105930709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105930709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105930709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105930710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105930710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105930710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:32.733427 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=11094): Process ended prematurely: osmo-stp_10.42.42.5(pid=11094) [trial-2403↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11094)] [trial-2403↪sms:nanobts+band-900↪mo_mt_sms.py:16] 10:59:32.741796 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 10:59:32.768086 run osmo-hlr_10.42.42.2(pid=11091): ERR: Terminated: ERROR {rc=237} [trial-2403↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11091)] 10:59:32.817272 run osmo-hlr_10.42.42.2(pid=11091): stdout: | (launched: 2022-12-14_10:59:29.609940) 10:59:32.867350 run osmo-hlr_10.42.42.2(pid=11091): stderr: | 20221214105929784 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105929784 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105929784 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105929784 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105929784 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105929784 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105929796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105929805 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105929805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105929805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:32.937141 run osmo-msc_10.42.42.6(pid=11097): ERR: Terminated: ERROR {rc=2} [trial-2403↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11097)] 10:59:32.984908 run osmo-msc_10.42.42.6(pid=11097): stdout: | (launched: 2022-12-14_10:59:31.567061) 10:59:33.034703 run osmo-msc_10.42.42.6(pid=11097): stderr: | 20221214105932084 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105932084 DLGLOBAL DEBUG validating counter group 0x7ff06b6d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105932084 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105932084 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105932084 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105932084 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105932094 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105932095 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105932095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105932095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:33.085038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11090): Terminating (SIGTERM) 10:59:33.125536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11093): Terminating (SIGTERM) 10:59:33.165975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11096): Terminating (SIGTERM) 10:59:33.206522 --- ParallelTerminationStrategy: PID 11090 died... 10:59:33.225869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11090): Terminated: ok {rc=0} 10:59:33.270457 --- ParallelTerminationStrategy: PID 11093 died... 10:59:33.289746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11093): Terminated: ok {rc=0} 10:59:33.334248 --- ParallelTerminationStrategy: PID 11096 died... 10:59:33.353396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11096): Terminated: ok {rc=0} 10:59:33.439924 bus /sierra_3: Setting Powered False 10:59:34.540356 bus /sierra_3: Setting Powered False 10:59:35.653618 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 10:59:36.893768 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:59:36.899216 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 10:59:36.931889 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 10:59:36.939451 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 10:59:36.975841 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 10:59:37.008785 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 10:59:37.015939 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 10:59:37.535094 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2403 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 10:59:37.540743 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 10:59:37.552140 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 10:59:37.599930 tst assert_extension.py: using LAC 40461 10:59:37.725351 tst assert_extension.py: using RAC 171 10:59:37.851250 tst assert_extension.py: using CellId 40461 10:59:37.975482 tst assert_extension.py: using BVCI 40462 10:59:38.092521 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 10:59:38.210204 tst assert_extension.py:10: start nitb and bts... 10:59:38.411008 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:59:39.024281 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11102): Launched 10:59:39.336327 run osmo-nitb_10.42.42.2(pid=11103): Launched 10:59:39.503034 run osmo-nitb_10.42.42.2(pid=11103): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11103)] 10:59:39.638488 run osmo-nitb_10.42.42.2(pid=11103): stdout: | (launched: 2022-12-14_10:59:39.280639) 10:59:39.775323 run osmo-nitb_10.42.42.2(pid=11103): stderr: | (launched: 2022-12-14_10:59:39.325255) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:59:39.912755 run osmo-nitb_10.42.42.2(pid=11103): stdout: | (launched: 2022-12-14_10:59:39.280639) 10:59:40.044853 run osmo-nitb_10.42.42.2(pid=11103): stderr: | (launched: 2022-12-14_10:59:39.325255) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11103): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11103) [trial-2403↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11103)] 10:59:40.449969 tst osmo-nitb_10.42.42.2(pid=11103): stdout: | (launched: 2022-12-14_10:59:39.280639) 10:59:40.570643 tst osmo-nitb_10.42.42.2(pid=11103): stderr: | (launched: 2022-12-14_10:59:39.325255) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:59:40.713439 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=11103): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11103) [trial-2403↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11103)] [trial-2403↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 10:59:40.722080 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:59:40.728864 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11102): Terminating (SIGTERM) 10:59:40.938389 --- ParallelTerminationStrategy: PID 11102 died... 10:59:40.959589 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11102): Terminated: ok {rc=0} 10:59:41.047887 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 ussd:nanobts+band-900 --------------------------------------------------------------------- 10:59:42.223149 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:59:42.228398 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 10:59:42.260509 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 10:59:42.288381 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 10:59:42.323513 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 10:59:42.355532 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 10:59:42.381991 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 10:59:42.911013 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2403 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 10:59:42.916014 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:42.926683 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 10:59:42.974315 tst assert_extension.py: using LAC 40462 10:59:43.094322 tst assert_extension.py: using RAC 172 10:59:43.215064 tst assert_extension.py: using CellId 40462 10:59:43.332698 tst assert_extension.py: using BVCI 40463 10:59:43.449492 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:43.460831 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:43.472166 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:43.483340 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:43.494662 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:59:43.506075 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 10:59:43.621591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:44.085332 run create_hlr_db(pid=11108): Launched 10:59:44.202111 bus /sierra_2: Setting Powered False 10:59:45.262188 run create_hlr_db(pid=11108): Terminated: ok {rc=0} 10:59:45.703744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11110): Launched 10:59:46.055839 run osmo-hlr_10.42.42.2(pid=11111): Launched 10:59:46.299861 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:46.960485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11113): Launched 10:59:47.296132 run osmo-stp_10.42.42.5(pid=11114): Launched 10:59:47.420377 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:47.999224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11116): Launched 10:59:48.320885 run osmo-msc_10.42.42.6(pid=11117): Launched 10:59:48.501845 run osmo-stp_10.42.42.5(pid=11114): ERR: Terminated: ERROR {rc=1} [trial-2403↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11114)] 10:59:48.636937 run osmo-stp_10.42.42.5(pid=11114): stdout: | (launched: 2022-12-14_10:59:47.237125) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:48.772546 run osmo-stp_10.42.42.5(pid=11114): stderr: | 20221214105947427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105947427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105947428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105947428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105947428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105947429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105947429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:48.906800 run osmo-stp_10.42.42.5(pid=11114): stdout: | (launched: 2022-12-14_10:59:47.237125) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:49.034618 run osmo-stp_10.42.42.5(pid=11114): stderr: | 20221214105947427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105947427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105947428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105947428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105947428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105947429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105947429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:49.187158 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=11114): Process ended prematurely: osmo-stp_10.42.42.5(pid=11114) [trial-2403↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11114)] [trial-2403↪ussd:nanobts+band-900↪assert_extension.py:17] 10:59:49.196317 tst assert_extension.py:17: Test FAILED (6.3 sec) 10:59:49.224160 run osmo-hlr_10.42.42.2(pid=11111): ERR: Terminated: ERROR {rc=237} [trial-2403↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11111)] 10:59:49.274613 run osmo-hlr_10.42.42.2(pid=11111): stdout: | (launched: 2022-12-14_10:59:45.996934) 10:59:49.326926 run osmo-hlr_10.42.42.2(pid=11111): stderr: | 20221214105946294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105946294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105946294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105946294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105946294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105946294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105946317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105946333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105946333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105946333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:49.399761 run osmo-msc_10.42.42.6(pid=11117): ERR: Terminated: ERROR {rc=2} [trial-2403↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11117)] 10:59:49.450617 run osmo-msc_10.42.42.6(pid=11117): stdout: | (launched: 2022-12-14_10:59:48.261856) 10:59:49.502662 run osmo-msc_10.42.42.6(pid=11117): stderr: | 20221214105948582 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105948582 DLGLOBAL DEBUG validating counter group 0x7f3021d55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105948582 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105948582 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105948582 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105948583 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105948584 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105948585 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105948585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105948585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:49.555287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11110): Terminating (SIGTERM) 10:59:49.597477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11113): Terminating (SIGTERM) 10:59:49.639572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11116): Terminating (SIGTERM) 10:59:49.682568 --- ParallelTerminationStrategy: PID 11110 died... 10:59:49.703134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11110): Terminated: ok {rc=0} 10:59:49.749809 --- ParallelTerminationStrategy: PID 11113 died... 10:59:49.769675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11113): Terminated: ok {rc=0} 10:59:49.815878 --- ParallelTerminationStrategy: PID 11116 died... 10:59:49.835765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11116): Terminated: ok {rc=0} 10:59:49.925051 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:59:51.139454 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:59:51.147356 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:59:51.179944 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:59:51.208061 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:59:51.260293 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:59:51.293752 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:59:51.321361 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:59:51.868884 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:59:51.924453 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:59:51.936450 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:59:52.003447 tst mo_mt_call.py: using LAC 40463 10:59:52.129888 tst mo_mt_call.py: using RAC 173 10:59:52.248587 tst mo_mt_call.py: using CellId 40463 10:59:52.366274 tst mo_mt_call.py: using BVCI 40464 10:59:52.479258 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:59:52.490693 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:59:52.501974 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:59:52.513156 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:59:52.524706 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:59:52.536057 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:59:52.657562 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:59:52.778708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:53.282257 run create_hlr_db(pid=11122): Launched 10:59:53.416802 bus /sierra_2: Setting Powered False 10:59:54.481349 run create_hlr_db(pid=11122): Terminated: ok {rc=0} 10:59:54.919715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11124): Launched 10:59:55.247962 run osmo-hlr_10.42.42.2(pid=11125): Launched 10:59:55.373569 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:55.939892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11127): Launched 10:59:56.268801 run osmo-stp_10.42.42.5(pid=11128): Launched 10:59:56.393663 run osmo-msc_10.42.42.6: Starting osmo-msc 10:59:56.982708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11130): Launched 10:59:57.309476 run osmo-msc_10.42.42.6(pid=11131): Launched 10:59:57.492560 run osmo-stp_10.42.42.5(pid=11128): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11128)] 10:59:57.630436 run osmo-stp_10.42.42.5(pid=11128): stdout: | (launched: 2022-12-14_10:59:56.208528) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:57.768605 run osmo-stp_10.42.42.5(pid=11128): stderr: | 20221214105956400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105956400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105956400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105956401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105956401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105956401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105956401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:57.904674 run osmo-stp_10.42.42.5(pid=11128): stdout: | (launched: 2022-12-14_10:59:56.208528) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:58.034719 run osmo-stp_10.42.42.5(pid=11128): stderr: | 20221214105956400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214105956400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214105956400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214105956401 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214105956401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214105956401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214105956401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:58.189459 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11128): Process ended prematurely: osmo-stp_10.42.42.5(pid=11128) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11128)] [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:59:58.199120 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:59:58.227242 run osmo-hlr_10.42.42.2(pid=11125): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11125)] 10:59:58.277642 run osmo-hlr_10.42.42.2(pid=11125): stdout: | (launched: 2022-12-14_10:59:55.188073) 10:59:58.329850 run osmo-hlr_10.42.42.2(pid=11125): stderr: | 20221214105955384 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214105955384 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214105955384 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214105955384 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214105955384 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214105955385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214105955398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214105955407 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214105955407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214105955407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:58.402961 run osmo-msc_10.42.42.6(pid=11131): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11131)] 10:59:58.453256 run osmo-msc_10.42.42.6(pid=11131): stdout: | (launched: 2022-12-14_10:59:57.249416) 10:59:58.505500 run osmo-msc_10.42.42.6(pid=11131): stderr: | 20221214105957571 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214105957571 DLGLOBAL DEBUG validating counter group 0x7fef6911dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214105957571 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214105957571 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214105957571 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214105957571 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214105957573 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214105957574 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214105957574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214105957574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:59:58.557765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11124): Terminating (SIGTERM) 10:59:58.599616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11127): Terminating (SIGTERM) 10:59:58.642033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11130): Terminating (SIGTERM) 10:59:58.684545 --- ParallelTerminationStrategy: PID 11124 died... 10:59:58.704887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11124): Terminated: ok {rc=0} 10:59:58.751427 --- ParallelTerminationStrategy: PID 11127 died... 10:59:58.771285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11127): Terminated: ok {rc=0} 10:59:58.817418 --- ParallelTerminationStrategy: PID 11130 died... 10:59:58.837126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11130): Terminated: ok {rc=0} 10:59:58.925384 bus /sierra_3: Setting Powered False 11:00:00.023558 bus /sierra_3: Setting Powered False 11:00:01.150797 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:00:02.305596 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:00:02.318197 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:00:02.388212 tst mo_mt_call_osmux.py: using LAC 40464 11:00:02.515725 tst mo_mt_call_osmux.py: using RAC 174 11:00:02.643652 tst mo_mt_call_osmux.py: using CellId 40464 11:00:02.773335 tst mo_mt_call_osmux.py: using BVCI 40465 11:00:02.891268 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:00:02.903324 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:00:02.914998 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:00:02.926601 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:00:02.938316 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:00:02.949848 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:00:03.067927 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:00:03.190308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:03.698233 run create_hlr_db(pid=11136): Launched 11:00:03.831853 bus /sierra_2: Setting Powered False 11:00:04.895929 run create_hlr_db(pid=11136): Terminated: ok {rc=0} 11:00:05.333957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11138): Launched 11:00:05.641827 run osmo-hlr_10.42.42.2(pid=11139): Launched 11:00:05.759688 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:06.287008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11141): Launched 11:00:06.596273 run osmo-stp_10.42.42.5(pid=11142): Launched 11:00:06.715021 run osmo-msc_10.42.42.6: Starting osmo-msc 11:00:07.268597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11144): Launched 11:00:07.574956 run osmo-msc_10.42.42.6(pid=11145): Launched 11:00:07.746656 run osmo-stp_10.42.42.5(pid=11142): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11142)] 11:00:07.875305 run osmo-stp_10.42.42.5(pid=11142): stdout: | (launched: 2022-12-14_11:00:06.539341) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:08.004624 run osmo-stp_10.42.42.5(pid=11142): stderr: | 20221214110006708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110006708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110006709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110006709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110006710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110006710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110006710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:08.133881 run osmo-stp_10.42.42.5(pid=11142): stdout: | (launched: 2022-12-14_11:00:06.539341) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:08.255585 run osmo-stp_10.42.42.5(pid=11142): stderr: | 20221214110006708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110006708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110006709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110006709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110006710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110006710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110006710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:08.401435 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11142): Process ended prematurely: osmo-stp_10.42.42.5(pid=11142) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11142)] [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:00:08.410758 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:00:08.437853 run osmo-hlr_10.42.42.2(pid=11139): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11139)] 11:00:08.486832 run osmo-hlr_10.42.42.2(pid=11139): stdout: | (launched: 2022-12-14_11:00:05.585173) 11:00:08.536767 run osmo-hlr_10.42.42.2(pid=11139): stderr: | 20221214110005760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110005760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110005760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110005760 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110005760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110005760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110005771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110005779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110005779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110005779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:08.606786 run osmo-msc_10.42.42.6(pid=11145): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11145)] 11:00:08.654266 run osmo-msc_10.42.42.6(pid=11145): stdout: | (launched: 2022-12-14_11:00:07.518361) 11:00:08.703694 run osmo-msc_10.42.42.6(pid=11145): stderr: | 20221214110007786 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110007787 DLGLOBAL DEBUG validating counter group 0x7f15cdbdec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110007787 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110007787 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110007787 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110007787 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110007789 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110007789 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110007789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110007789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:00:08.753876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11138): Terminating (SIGTERM) 11:00:08.794445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11141): Terminating (SIGTERM) 11:00:08.834920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11144): Terminating (SIGTERM) 11:00:08.875637 --- ParallelTerminationStrategy: PID 11138 died... 11:00:08.895628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11138): Terminated: ok {rc=0} 11:00:08.940173 --- ParallelTerminationStrategy: PID 11141 died... 11:00:08.959395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11141): Terminated: ok {rc=0} 11:00:09.003696 --- ParallelTerminationStrategy: PID 11144 died... 11:00:09.022930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11144): Terminated: ok {rc=0} 11:00:09.110359 bus /sierra_3: Setting Powered False 11:00:10.209958 bus /sierra_3: Setting Powered False 11:00:11.325344 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:00:12.582459 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:00:12.589951 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:00:12.621745 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:00:12.649211 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:00:12.702616 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:00:12.735887 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:00:12.765293 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:00:13.310720 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:00:13.361416 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:00:13.372452 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:00:13.440181 tst mo_mt_call.py: using LAC 40465 11:00:13.562325 tst mo_mt_call.py: using RAC 175 11:00:13.682464 tst mo_mt_call.py: using CellId 40465 11:00:13.804424 tst mo_mt_call.py: using BVCI 40466 11:00:13.916520 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:00:13.927740 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:00:13.938724 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:00:13.949697 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:00:13.961073 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:00:13.972445 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:00:14.093684 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:00:14.215065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:14.722093 run create_hlr_db(pid=11150): Launched 11:00:14.856093 bus /sierra_2: Setting Powered False 11:00:15.948338 run create_hlr_db(pid=11150): Terminated: ok {rc=0} 11:00:16.401723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11152): Launched 11:00:16.735464 run osmo-hlr_10.42.42.2(pid=11153): Launched 11:00:16.986830 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:17.604047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11155): Launched 11:00:17.933415 run osmo-stp_10.42.42.5(pid=11156): Launched 11:00:18.057289 run osmo-msc_10.42.42.6: Starting osmo-msc 11:00:18.649711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11158): Launched 11:00:18.977314 run osmo-msc_10.42.42.6(pid=11159): Launched 11:00:19.160106 run osmo-stp_10.42.42.5(pid=11156): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11156)] 11:00:19.297916 run osmo-stp_10.42.42.5(pid=11156): stdout: | (launched: 2022-12-14_11:00:17.873224) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:19.435944 run osmo-stp_10.42.42.5(pid=11156): stderr: | 20221214110018065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110018065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110018065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110018065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110018066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110018066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110018066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:19.572722 run osmo-stp_10.42.42.5(pid=11156): stdout: | (launched: 2022-12-14_11:00:17.873224) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:19.703050 run osmo-stp_10.42.42.5(pid=11156): stderr: | 20221214110018065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110018065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110018065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110018065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110018066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110018066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110018066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:19.858028 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11156): Process ended prematurely: osmo-stp_10.42.42.5(pid=11156) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11156)] [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:00:19.867910 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 11:00:19.896258 run osmo-hlr_10.42.42.2(pid=11153): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11153)] 11:00:19.947030 run osmo-hlr_10.42.42.2(pid=11153): stdout: | (launched: 2022-12-14_11:00:16.674588) 11:00:19.999309 run osmo-hlr_10.42.42.2(pid=11153): stderr: | 20221214110017012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110017012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110017012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110017012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110017012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110017012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110017038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110017046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110017046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110017046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:20.072458 run osmo-msc_10.42.42.6(pid=11159): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11159)] 11:00:20.123289 run osmo-msc_10.42.42.6(pid=11159): stdout: | (launched: 2022-12-14_11:00:18.917287) 11:00:20.176318 run osmo-msc_10.42.42.6(pid=11159): stderr: | 20221214110019238 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110019238 DLGLOBAL DEBUG validating counter group 0x7ff8e9ee9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110019238 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110019238 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110019238 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110019238 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110019240 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110019241 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110019241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110019241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:00:20.229102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11152): Terminating (SIGTERM) 11:00:20.271357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11155): Terminating (SIGTERM) 11:00:20.313513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11158): Terminating (SIGTERM) 11:00:20.356035 --- ParallelTerminationStrategy: PID 11152 died... 11:00:20.376796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11152): Terminated: ok {rc=0} 11:00:20.423509 --- ParallelTerminationStrategy: PID 11155 died... 11:00:20.443433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11155): Terminated: ok {rc=0} 11:00:20.489895 --- ParallelTerminationStrategy: PID 11158 died... 11:00:20.509883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11158): Terminated: ok {rc=0} 11:00:20.598911 bus /sierra_3: Setting Powered False 11:00:21.699368 bus /sierra_3: Setting Powered False 11:00:22.816256 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:00:23.966809 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:00:23.979124 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:00:24.048821 tst mo_mt_call_osmux.py: using LAC 40466 11:00:24.179170 tst mo_mt_call_osmux.py: using RAC 176 11:00:24.309131 tst mo_mt_call_osmux.py: using CellId 40466 11:00:24.438653 tst mo_mt_call_osmux.py: using BVCI 40467 11:00:24.558531 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:00:24.570245 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:00:24.581810 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:00:24.593380 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:00:24.605037 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:00:24.616824 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:00:24.736339 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:00:24.857210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:25.364938 run create_hlr_db(pid=11161): Launched 11:00:25.498209 bus /sierra_2: Setting Powered False 11:00:26.563557 run create_hlr_db(pid=11161): Terminated: ok {rc=0} 11:00:27.004488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11163): Launched 11:00:27.312541 run osmo-hlr_10.42.42.2(pid=11164): Launched 11:00:27.430477 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:27.962484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11166): Launched 11:00:28.269387 run osmo-stp_10.42.42.5(pid=11167): Launched 11:00:28.386687 run osmo-msc_10.42.42.6: Starting osmo-msc 11:00:28.939906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11169): Launched 11:00:29.246854 run osmo-msc_10.42.42.6(pid=11170): Launched 11:00:29.419963 run osmo-stp_10.42.42.5(pid=11167): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11167)] 11:00:29.549490 run osmo-stp_10.42.42.5(pid=11167): stdout: | (launched: 2022-12-14_11:00:28.212779) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:29.678938 run osmo-stp_10.42.42.5(pid=11167): stderr: | 20221214110028382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110028383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110028383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110028383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110028384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110028384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110028384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:29.807235 run osmo-stp_10.42.42.5(pid=11167): stdout: | (launched: 2022-12-14_11:00:28.212779) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:29.928198 run osmo-stp_10.42.42.5(pid=11167): stderr: | 20221214110028382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110028383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110028383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110028383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110028384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110028384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110028384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:30.073437 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11167): Process ended prematurely: osmo-stp_10.42.42.5(pid=11167) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11167)] [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:00:30.082420 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:00:30.109090 run osmo-hlr_10.42.42.2(pid=11164): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11164)] 11:00:30.158214 run osmo-hlr_10.42.42.2(pid=11164): stdout: | (launched: 2022-12-14_11:00:27.256249) 11:00:30.208166 run osmo-hlr_10.42.42.2(pid=11164): stderr: | 20221214110027430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110027430 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110027430 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110027430 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110027430 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110027430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110027442 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110027450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110027450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110027450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:30.278073 run osmo-msc_10.42.42.6(pid=11170): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11170)] 11:00:30.325604 run osmo-msc_10.42.42.6(pid=11170): stdout: | (launched: 2022-12-14_11:00:29.190278) 11:00:30.375214 run osmo-msc_10.42.42.6(pid=11170): stderr: | 20221214110029459 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110029459 DLGLOBAL DEBUG validating counter group 0x7f2bd4e7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110029459 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110029459 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110029459 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110029459 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110029461 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110029461 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110029462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110029462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:00:30.425229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11163): Terminating (SIGTERM) 11:00:30.465652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11166): Terminating (SIGTERM) 11:00:30.505743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11169): Terminating (SIGTERM) 11:00:30.546060 --- ParallelTerminationStrategy: PID 11163 died... 11:00:30.565672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11163): Terminated: ok {rc=0} 11:00:30.609850 --- ParallelTerminationStrategy: PID 11166 died... 11:00:30.628658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11166): Terminated: ok {rc=0} 11:00:30.672853 --- ParallelTerminationStrategy: PID 11169 died... 11:00:30.692222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11169): Terminated: ok {rc=0} 11:00:30.779239 bus /sierra_3: Setting Powered False 11:00:31.888182 bus /sierra_3: Setting Powered False 11:00:33.021601 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:00:34.270921 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:00:34.278419 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:00:34.310020 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:00:34.337191 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:00:34.389507 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:00:34.423461 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:00:34.451653 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:00:34.998766 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:00:35.048930 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:00:35.060229 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:00:35.126875 tst mo_mt_call.py: using LAC 40467 11:00:35.246496 tst mo_mt_call.py: using RAC 177 11:00:35.365631 tst mo_mt_call.py: using CellId 40467 11:00:35.485422 tst mo_mt_call.py: using BVCI 40468 11:00:35.605488 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:00:35.617300 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:00:35.629353 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:00:35.641056 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:00:35.653141 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:00:35.665068 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:00:35.783860 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:00:35.904456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:36.380895 run create_hlr_db(pid=11175): Launched 11:00:36.497880 bus /sierra_2: Setting Powered False 11:00:37.561689 run create_hlr_db(pid=11175): Terminated: ok {rc=0} 11:00:38.001532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11177): Launched 11:00:38.311270 run osmo-hlr_10.42.42.2(pid=11178): Launched 11:00:38.428620 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:38.967110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11180): Launched 11:00:39.273532 run osmo-stp_10.42.42.5(pid=11181): Launched 11:00:39.391150 run osmo-msc_10.42.42.6: Starting osmo-msc 11:00:39.944660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11183): Launched 11:00:40.251346 run osmo-msc_10.42.42.6(pid=11184): Launched 11:00:40.423596 run osmo-stp_10.42.42.5(pid=11181): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11181)] 11:00:40.553555 run osmo-stp_10.42.42.5(pid=11181): stdout: | (launched: 2022-12-14_11:00:39.216815) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:40.682743 run osmo-stp_10.42.42.5(pid=11181): stderr: | 20221214110039386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110039387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110039387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110039387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110039388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110039388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110039388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:40.809523 run osmo-stp_10.42.42.5(pid=11181): stdout: | (launched: 2022-12-14_11:00:39.216815) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:40.930565 run osmo-stp_10.42.42.5(pid=11181): stderr: | 20221214110039386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110039387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110039387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110039387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110039388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110039388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110039388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:41.076007 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11181): Process ended prematurely: osmo-stp_10.42.42.5(pid=11181) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11181)] [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:00:41.085059 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:00:41.111627 run osmo-hlr_10.42.42.2(pid=11178): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11178)] 11:00:41.159958 run osmo-hlr_10.42.42.2(pid=11178): stdout: | (launched: 2022-12-14_11:00:38.254404) 11:00:41.209706 run osmo-hlr_10.42.42.2(pid=11178): stderr: | 20221214110038427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110038427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110038427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110038427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110038427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110038427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110038439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110038447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110038447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110038447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:41.279692 run osmo-msc_10.42.42.6(pid=11184): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11184)] 11:00:41.327177 run osmo-msc_10.42.42.6(pid=11184): stdout: | (launched: 2022-12-14_11:00:40.194831) 11:00:41.376897 run osmo-msc_10.42.42.6(pid=11184): stderr: | 20221214110040464 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110040465 DLGLOBAL DEBUG validating counter group 0x7fd9616c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110040465 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110040465 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110040465 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110040465 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110040467 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110040467 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110040467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110040467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:00:41.426914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11177): Terminating (SIGTERM) 11:00:41.466894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11180): Terminating (SIGTERM) 11:00:41.506804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11183): Terminating (SIGTERM) 11:00:41.547064 --- ParallelTerminationStrategy: PID 11177 died... 11:00:41.566606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11177): Terminated: ok {rc=0} 11:00:41.610754 --- ParallelTerminationStrategy: PID 11180 died... 11:00:41.629713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11180): Terminated: ok {rc=0} 11:00:41.673675 --- ParallelTerminationStrategy: PID 11183 died... 11:00:41.692623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11183): Terminated: ok {rc=0} 11:00:41.779201 bus /sierra_3: Setting Powered False 11:00:42.879553 bus /sierra_3: Setting Powered False 11:00:43.993913 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:00:45.140001 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:00:45.151934 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:00:45.219485 tst mo_mt_call_osmux.py: using LAC 40468 11:00:45.342066 tst mo_mt_call_osmux.py: using RAC 178 11:00:45.463543 tst mo_mt_call_osmux.py: using CellId 40468 11:00:45.589723 tst mo_mt_call_osmux.py: using BVCI 40469 11:00:45.710985 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:00:45.722955 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:00:45.734750 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:00:45.746891 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:00:45.758998 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:00:45.771017 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:00:45.917428 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:00:46.045551 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:46.538818 run create_hlr_db(pid=11186): Launched 11:00:46.700193 bus /sierra_2: Setting Powered False 11:00:47.762530 run create_hlr_db(pid=11186): Terminated: ok {rc=0} 11:00:48.213652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11188): Launched 11:00:48.543288 run osmo-hlr_10.42.42.2(pid=11189): Launched 11:00:48.670347 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:49.232674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11191): Launched 11:00:49.561766 run osmo-stp_10.42.42.5(pid=11192): Launched 11:00:49.688683 run osmo-msc_10.42.42.6: Starting osmo-msc 11:00:50.280657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11194): Launched 11:00:50.611353 run osmo-msc_10.42.42.6(pid=11195): Launched 11:00:50.795406 run osmo-stp_10.42.42.5(pid=11192): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11192)] 11:00:50.932926 run osmo-stp_10.42.42.5(pid=11192): stdout: | (launched: 2022-12-14_11:00:49.501476) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:51.071107 run osmo-stp_10.42.42.5(pid=11192): stderr: | 20221214110049692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110049692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110049692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110049693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110049693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110049693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110049693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:51.208138 run osmo-stp_10.42.42.5(pid=11192): stdout: | (launched: 2022-12-14_11:00:49.501476) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:51.338342 run osmo-stp_10.42.42.5(pid=11192): stderr: | 20221214110049692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110049692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110049692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110049693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110049693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110049693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110049693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:51.494270 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11192): Process ended prematurely: osmo-stp_10.42.42.5(pid=11192) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11192)] [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:00:51.504220 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:00:51.532603 run osmo-hlr_10.42.42.2(pid=11189): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11189)] 11:00:51.583853 run osmo-hlr_10.42.42.2(pid=11189): stdout: | (launched: 2022-12-14_11:00:48.483098) 11:00:51.636713 run osmo-hlr_10.42.42.2(pid=11189): stderr: | 20221214110048680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110048680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110048680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110048680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110048680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110048680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110048692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110048701 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110048701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110048702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:51.710204 run osmo-msc_10.42.42.6(pid=11195): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11195)] 11:00:51.760680 run osmo-msc_10.42.42.6(pid=11195): stdout: | (launched: 2022-12-14_11:00:50.550863) 11:00:51.812897 run osmo-msc_10.42.42.6(pid=11195): stderr: | 20221214110050873 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110050873 DLGLOBAL DEBUG validating counter group 0x7fbddf2e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110050873 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110050874 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110050874 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110050874 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110050876 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110050876 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110050876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110050876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:00:51.865479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11188): Terminating (SIGTERM) 11:00:51.907816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11191): Terminating (SIGTERM) 11:00:51.950493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11194): Terminating (SIGTERM) 11:00:51.996423 --- ParallelTerminationStrategy: PID 11188 died... 11:00:52.016583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11188): Terminated: ok {rc=0} 11:00:52.062099 --- ParallelTerminationStrategy: PID 11191 died... 11:00:52.085459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11191): Terminated: ok {rc=0} 11:00:52.132291 --- ParallelTerminationStrategy: PID 11194 died... 11:00:52.152557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11194): Terminated: ok {rc=0} 11:00:52.242102 bus /sierra_3: Setting Powered False 11:00:53.341137 bus /sierra_3: Setting Powered False 11:00:54.459757 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:00:55.708924 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:00:55.716136 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:00:55.747668 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:00:55.774822 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:00:55.827282 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:00:55.861008 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:00:55.888996 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:00:56.435820 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:00:56.486229 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:56.497741 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:00:56.563640 tst mo_mt_call.py: using LAC 40469 11:00:56.684903 tst mo_mt_call.py: using RAC 179 11:00:56.804859 tst mo_mt_call.py: using CellId 40469 11:00:56.933527 tst mo_mt_call.py: using BVCI 40470 11:00:57.046801 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:57.058140 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:57.069393 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:57.080486 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:57.092036 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:00:57.103602 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:00:57.224740 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:00:57.343138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:57.818949 run create_hlr_db(pid=11202): Launched 11:00:57.938519 bus /sierra_2: Setting Powered False 11:00:59.000126 run create_hlr_db(pid=11202): Terminated: ok {rc=0} 11:00:59.428235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11204): Launched 11:00:59.736265 run osmo-hlr_10.42.42.2(pid=11205): Launched 11:00:59.853707 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:00.382297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11207): Launched 11:01:00.690213 run osmo-stp_10.42.42.5(pid=11208): Launched 11:01:00.807676 run osmo-msc_10.42.42.6: Starting osmo-msc 11:01:01.487097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11212): Launched 11:01:01.902970 run osmo-msc_10.42.42.6(pid=11213): Launched 11:01:02.134850 run osmo-stp_10.42.42.5(pid=11208): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11208)] 11:01:02.284468 run osmo-stp_10.42.42.5(pid=11208): stdout: | (launched: 2022-12-14_11:01:00.633511) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:02.430380 run osmo-stp_10.42.42.5(pid=11208): stderr: | 20221214110100801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110100802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110100802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110100802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110100803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110100803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110100803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:02.571622 run osmo-stp_10.42.42.5(pid=11208): stdout: | (launched: 2022-12-14_11:01:00.633511) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:02.703777 run osmo-stp_10.42.42.5(pid=11208): stderr: | 20221214110100801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110100802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110100802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110100802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110100803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110100803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110100803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:02.859749 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11208): Process ended prematurely: osmo-stp_10.42.42.5(pid=11208) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11208)] [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:01:02.869543 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:01:02.897663 run osmo-hlr_10.42.42.2(pid=11205): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11205)] 11:01:02.949370 run osmo-hlr_10.42.42.2(pid=11205): stdout: | (launched: 2022-12-14_11:00:59.679314) 11:01:03.002210 run osmo-hlr_10.42.42.2(pid=11205): stderr: | 20221214110059854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110059854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110059854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110059854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110059854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110059855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110059867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110059877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110059877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110059877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:03.076039 run osmo-msc_10.42.42.6(pid=11213): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11213)] 11:01:03.126754 run osmo-msc_10.42.42.6(pid=11213): stdout: | (launched: 2022-12-14_11:01:01.844087) 11:01:03.179132 run osmo-msc_10.42.42.6(pid=11213): stderr: | 20221214110102393 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110102393 DLGLOBAL DEBUG validating counter group 0x7f0176ce1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110102393 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110102393 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110102394 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110102394 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110102395 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110102396 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110102396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110102396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:01:03.232110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11204): Terminating (SIGTERM) 11:01:03.274790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11207): Terminating (SIGTERM) 11:01:03.317642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11212): Terminating (SIGTERM) 11:01:03.360887 --- ParallelTerminationStrategy: PID 11204 died... 11:01:03.381681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11204): Terminated: ok {rc=0} 11:01:03.429118 --- ParallelTerminationStrategy: PID 11207 died... 11:01:03.449667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11207): Terminated: ok {rc=0} 11:01:03.496937 --- ParallelTerminationStrategy: PID 11212 died... 11:01:03.517816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11212): Terminated: ok {rc=0} 11:01:03.607130 bus /sierra_3: Setting Powered False 11:01:04.707036 bus /sierra_3: Setting Powered False 11:01:05.827402 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:01:06.975345 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:01:06.987257 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:01:07.054182 tst mo_mt_call_osmux.py: using LAC 40470 11:01:07.178014 tst mo_mt_call_osmux.py: using RAC 180 11:01:07.297394 tst mo_mt_call_osmux.py: using CellId 40470 11:01:07.415424 tst mo_mt_call_osmux.py: using BVCI 40471 11:01:07.536851 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:01:07.548803 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:01:07.560693 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:01:07.572418 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:01:07.584847 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:01:07.597252 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:01:07.718105 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:01:07.840733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:08.348555 run create_hlr_db(pid=11215): Launched 11:01:08.482253 bus /sierra_2: Setting Powered False 11:01:09.547352 run create_hlr_db(pid=11215): Terminated: ok {rc=0} 11:01:10.003789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11217): Launched 11:01:10.334107 run osmo-hlr_10.42.42.2(pid=11218): Launched 11:01:10.460224 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:11.030348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11220): Launched 11:01:11.359619 run osmo-stp_10.42.42.5(pid=11221): Launched 11:01:11.484596 run osmo-msc_10.42.42.6: Starting osmo-msc 11:01:12.077028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11223): Launched 11:01:12.406504 run osmo-msc_10.42.42.6(pid=11224): Launched 11:01:12.590090 run osmo-stp_10.42.42.5(pid=11221): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11221)] 11:01:12.729452 run osmo-stp_10.42.42.5(pid=11221): stdout: | (launched: 2022-12-14_11:01:11.299097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:12.867704 run osmo-stp_10.42.42.5(pid=11221): stderr: | 20221214110111489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110111489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110111489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110111490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110111490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110111490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110111490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:13.004040 run osmo-stp_10.42.42.5(pid=11221): stdout: | (launched: 2022-12-14_11:01:11.299097) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:13.134489 run osmo-stp_10.42.42.5(pid=11221): stderr: | 20221214110111489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110111489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110111489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110111490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110111490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110111490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110111490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:13.289813 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11221): Process ended prematurely: osmo-stp_10.42.42.5(pid=11221) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11221)] [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:01:13.299724 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:01:13.328208 run osmo-hlr_10.42.42.2(pid=11218): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11218)] 11:01:13.378643 run osmo-hlr_10.42.42.2(pid=11218): stdout: | (launched: 2022-12-14_11:01:10.274016) 11:01:13.430592 run osmo-hlr_10.42.42.2(pid=11218): stderr: | 20221214110110470 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110110470 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110110470 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110110470 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110110470 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110110470 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110110482 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110110491 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110110491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110110491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:13.503321 run osmo-msc_10.42.42.6(pid=11224): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11224)] 11:01:13.553765 run osmo-msc_10.42.42.6(pid=11224): stdout: | (launched: 2022-12-14_11:01:12.346256) 11:01:13.605757 run osmo-msc_10.42.42.6(pid=11224): stderr: | 20221214110112667 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110112667 DLGLOBAL DEBUG validating counter group 0x7f3b9f951c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110112667 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110112668 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110112668 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110112668 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110112670 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110112670 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110112670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110112670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:01:13.658375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11217): Terminating (SIGTERM) 11:01:13.700620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11220): Terminating (SIGTERM) 11:01:13.743233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11223): Terminating (SIGTERM) 11:01:13.785952 --- ParallelTerminationStrategy: PID 11217 died... 11:01:13.806572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11217): Terminated: ok {rc=0} 11:01:13.853614 --- ParallelTerminationStrategy: PID 11220 died... 11:01:13.873208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11220): Terminated: ok {rc=0} 11:01:13.920060 --- ParallelTerminationStrategy: PID 11223 died... 11:01:13.940050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11223): Terminated: ok {rc=0} 11:01:14.028573 bus /sierra_3: Setting Powered False 11:01:15.127876 bus /sierra_3: Setting Powered False 11:01:16.248828 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:01:17.512139 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:01:17.519781 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:01:17.551847 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:01:17.579179 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:01:17.632157 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:01:17.666367 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:01:17.694050 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:01:18.245960 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:01:18.297196 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:01:18.308469 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:01:18.374535 tst mo_mt_call.py: using LAC 40471 11:01:18.493380 tst mo_mt_call.py: using RAC 181 11:01:18.615332 tst mo_mt_call.py: using CellId 40471 11:01:18.739283 tst mo_mt_call.py: using BVCI 40472 11:01:18.851761 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:01:18.863140 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:01:18.874272 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:01:18.885365 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:01:18.896823 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:01:18.908386 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:01:19.029332 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:01:19.151146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:19.626287 run create_hlr_db(pid=11229): Launched 11:01:19.745752 bus /sierra_2: Setting Powered False 11:01:20.806705 run create_hlr_db(pid=11229): Terminated: ok {rc=0} 11:01:21.254228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11231): Launched 11:01:21.583260 run osmo-hlr_10.42.42.2(pid=11232): Launched 11:01:21.710503 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:22.272062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11234): Launched 11:01:22.602388 run osmo-stp_10.42.42.5(pid=11235): Launched 11:01:22.728300 run osmo-msc_10.42.42.6: Starting osmo-msc 11:01:23.318286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11237): Launched 11:01:23.646620 run osmo-msc_10.42.42.6(pid=11238): Launched 11:01:23.830468 run osmo-stp_10.42.42.5(pid=11235): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11235)] 11:01:23.967965 run osmo-stp_10.42.42.5(pid=11235): stdout: | (launched: 2022-12-14_11:01:22.541866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:24.107204 run osmo-stp_10.42.42.5(pid=11235): stderr: | 20221214110122733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110122733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110122734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110122734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110122735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110122735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110122735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:24.244021 run osmo-stp_10.42.42.5(pid=11235): stdout: | (launched: 2022-12-14_11:01:22.541866) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:24.373832 run osmo-stp_10.42.42.5(pid=11235): stderr: | 20221214110122733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110122733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110122734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110122734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110122735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110122735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110122735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:24.528830 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11235): Process ended prematurely: osmo-stp_10.42.42.5(pid=11235) [trial-2403↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11235)] [trial-2403↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:01:24.538577 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:01:24.566797 run osmo-hlr_10.42.42.2(pid=11232): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11232)] 11:01:24.617697 run osmo-hlr_10.42.42.2(pid=11232): stdout: | (launched: 2022-12-14_11:01:21.522715) 11:01:24.670861 run osmo-hlr_10.42.42.2(pid=11232): stderr: | 20221214110121718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110121718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110121718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110121718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110121719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110121719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110121731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110121740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110121740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110121740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:24.744144 run osmo-msc_10.42.42.6(pid=11238): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11238)] 11:01:24.795307 run osmo-msc_10.42.42.6(pid=11238): stdout: | (launched: 2022-12-14_11:01:23.586468) 11:01:24.847588 run osmo-msc_10.42.42.6(pid=11238): stderr: | 20221214110123906 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110123907 DLGLOBAL DEBUG validating counter group 0x7f3005f86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110123907 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110123907 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110123907 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110123907 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110123909 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110123909 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110123909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110123910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:01:24.900046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11231): Terminating (SIGTERM) 11:01:24.942353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11234): Terminating (SIGTERM) 11:01:24.984661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11237): Terminating (SIGTERM) 11:01:25.027270 --- ParallelTerminationStrategy: PID 11231 died... 11:01:25.047381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11231): Terminated: ok {rc=0} 11:01:25.094244 --- ParallelTerminationStrategy: PID 11234 died... 11:01:25.114147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11234): Terminated: ok {rc=0} 11:01:25.160592 --- ParallelTerminationStrategy: PID 11237 died... 11:01:25.180448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11237): Terminated: ok {rc=0} 11:01:25.270210 bus /sierra_3: Setting Powered False 11:01:26.370814 bus /sierra_3: Setting Powered False 11:01:27.487741 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:01:28.638036 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:01:28.650970 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:01:28.724429 tst mo_mt_call_osmux.py: using LAC 40472 11:01:28.851707 tst mo_mt_call_osmux.py: using RAC 182 11:01:28.977698 tst mo_mt_call_osmux.py: using CellId 40472 11:01:29.103915 tst mo_mt_call_osmux.py: using BVCI 40473 11:01:29.222252 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:01:29.234014 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:01:29.245650 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:01:29.257295 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:01:29.268867 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:01:29.280428 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:01:29.401666 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:01:29.520835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:29.994379 run create_hlr_db(pid=11240): Launched 11:01:30.114176 bus /sierra_2: Setting Powered False 11:01:31.174003 run create_hlr_db(pid=11240): Terminated: ok {rc=0} 11:01:31.613491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11242): Launched 11:01:31.940490 run osmo-hlr_10.42.42.2(pid=11243): Launched 11:01:32.226747 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:32.820840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11245): Launched 11:01:33.151099 run osmo-stp_10.42.42.5(pid=11246): Launched 11:01:33.277304 run osmo-msc_10.42.42.6: Starting osmo-msc 11:01:33.867964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11248): Launched 11:01:34.198090 run osmo-msc_10.42.42.6(pid=11249): Launched 11:01:34.381323 run osmo-stp_10.42.42.5(pid=11246): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11246)] 11:01:34.518133 run osmo-stp_10.42.42.5(pid=11246): stdout: | (launched: 2022-12-14_11:01:33.090341) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:34.656138 run osmo-stp_10.42.42.5(pid=11246): stderr: | 20221214110133281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110133281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110133281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110133282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110133282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110133282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110133282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:34.793843 run osmo-stp_10.42.42.5(pid=11246): stdout: | (launched: 2022-12-14_11:01:33.090341) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:34.923874 run osmo-stp_10.42.42.5(pid=11246): stderr: | 20221214110133281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110133281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110133281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110133282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110133282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110133282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110133282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:35.079353 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11246): Process ended prematurely: osmo-stp_10.42.42.5(pid=11246) [trial-2403↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11246)] [trial-2403↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:01:35.089283 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:01:35.117831 run osmo-hlr_10.42.42.2(pid=11243): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11243)] 11:01:35.168309 run osmo-hlr_10.42.42.2(pid=11243): stdout: | (launched: 2022-12-14_11:01:31.882639) 11:01:35.220693 run osmo-hlr_10.42.42.2(pid=11243): stderr: | 20221214110132179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110132179 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110132179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110132179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110132179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110132179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110132195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110132210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110132211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110132211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:35.293556 run osmo-msc_10.42.42.6(pid=11249): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11249)] 11:01:35.343976 run osmo-msc_10.42.42.6(pid=11249): stdout: | (launched: 2022-12-14_11:01:34.137530) 11:01:35.396182 run osmo-msc_10.42.42.6(pid=11249): stderr: | 20221214110134458 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110134458 DLGLOBAL DEBUG validating counter group 0x7fa399795c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110134458 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110134458 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110134458 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110134459 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110134460 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110134461 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110134461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110134461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:01:35.449258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11242): Terminating (SIGTERM) 11:01:35.491298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11245): Terminating (SIGTERM) 11:01:35.533428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11248): Terminating (SIGTERM) 11:01:35.575643 --- ParallelTerminationStrategy: PID 11242 died... 11:01:35.596025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11242): Terminated: ok {rc=0} 11:01:35.642443 --- ParallelTerminationStrategy: PID 11245 died... 11:01:35.662462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11245): Terminated: ok {rc=0} 11:01:35.708942 --- ParallelTerminationStrategy: PID 11248 died... 11:01:35.728703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11248): Terminated: ok {rc=0} 11:01:35.816890 bus /sierra_3: Setting Powered False 11:01:36.915958 bus /sierra_3: Setting Powered False 11:01:38.033669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:01:39.286618 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:01:39.294210 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:01:39.327259 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 11:01:39.354486 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 11:01:39.407805 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:01:39.441286 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 11:01:39.468759 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 11:01:40.018843 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 11:01:40.069101 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:01:40.080405 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:01:40.130318 tst mo_mt_call.py: using LAC 40473 11:01:40.253717 tst mo_mt_call.py: using RAC 183 11:01:40.382899 tst mo_mt_call.py: using CellId 40473 11:01:40.511716 tst mo_mt_call.py: using BVCI 40474 11:01:40.624900 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:01:40.636618 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:01:40.648175 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:01:40.659586 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:01:40.671929 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:01:40.684207 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:01:40.807047 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:01:40.925618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:41.400898 run create_hlr_db(pid=11254): Launched 11:01:41.518241 bus /sierra_2: Setting Powered False 11:01:42.579688 run create_hlr_db(pid=11254): Terminated: ok {rc=0} 11:01:43.029232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11256): Launched 11:01:43.358879 run osmo-hlr_10.42.42.2(pid=11257): Launched 11:01:43.484477 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:44.051351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11259): Launched 11:01:44.377733 run osmo-stp_10.42.42.5(pid=11260): Launched 11:01:44.502640 run osmo-msc_10.42.42.6: Starting osmo-msc 11:01:45.094330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11262): Launched 11:01:45.422035 run osmo-msc_10.42.42.6(pid=11263): Launched 11:01:45.605774 run osmo-stp_10.42.42.5(pid=11260): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11260)] 11:01:45.743612 run osmo-stp_10.42.42.5(pid=11260): stdout: | (launched: 2022-12-14_11:01:44.317739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:45.932042 run osmo-stp_10.42.42.5(pid=11260): stderr: | 20221214110144508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110144508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110144509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110144509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110144509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110144510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110144510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:46.082036 run osmo-stp_10.42.42.5(pid=11260): stdout: | (launched: 2022-12-14_11:01:44.317739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:46.210841 run osmo-stp_10.42.42.5(pid=11260): stderr: | 20221214110144508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110144508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110144509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110144509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110144509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110144510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110144510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:46.363069 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11260): Process ended prematurely: osmo-stp_10.42.42.5(pid=11260) [trial-2403↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11260)] [trial-2403↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 11:01:46.373381 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:01:46.401472 run osmo-hlr_10.42.42.2(pid=11257): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11257)] 11:01:46.453271 run osmo-hlr_10.42.42.2(pid=11257): stdout: | (launched: 2022-12-14_11:01:43.298674) 11:01:46.505728 run osmo-hlr_10.42.42.2(pid=11257): stderr: | 20221214110143494 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110143494 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110143494 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110143494 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110143494 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110143494 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110143506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110143515 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110143515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110143515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:46.580499 run osmo-msc_10.42.42.6(pid=11263): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11263)] 11:01:46.631709 run osmo-msc_10.42.42.6(pid=11263): stdout: | (launched: 2022-12-14_11:01:45.361671) 11:01:46.685861 run osmo-msc_10.42.42.6(pid=11263): stderr: | 20221214110145682 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110145682 DLGLOBAL DEBUG validating counter group 0x7ff9f4f19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110145682 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110145682 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110145682 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110145682 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110145684 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110145684 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110145684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110145685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:01:46.738737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11256): Terminating (SIGTERM) 11:01:46.782045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11259): Terminating (SIGTERM) 11:01:46.827346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11262): Terminating (SIGTERM) 11:01:46.873040 --- ParallelTerminationStrategy: PID 11256 died... 11:01:46.894618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11256): Terminated: ok {rc=0} 11:01:46.943292 --- ParallelTerminationStrategy: PID 11259 died... 11:01:46.965718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11259): Terminated: ok {rc=0} 11:01:47.012574 --- ParallelTerminationStrategy: PID 11262 died... 11:01:47.033758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11262): Terminated: ok {rc=0} 11:01:47.126378 bus /sierra_3: Setting Powered False 11:01:48.226997 bus /sierra_3: Setting Powered False 11:01:49.344677 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 11:01:50.494443 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:01:50.507183 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:01:50.558613 tst mo_mt_call_osmux.py: using LAC 40474 11:01:50.680720 tst mo_mt_call_osmux.py: using RAC 184 11:01:50.801190 tst mo_mt_call_osmux.py: using CellId 40474 11:01:50.923660 tst mo_mt_call_osmux.py: using BVCI 40475 11:01:51.035821 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:01:51.047520 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:01:51.058899 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:01:51.070258 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:01:51.082175 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:01:51.093814 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:01:51.214887 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:01:51.336390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:51.844349 run create_hlr_db(pid=11265): Launched 11:01:51.981010 bus /sierra_2: Setting Powered False 11:01:53.045544 run create_hlr_db(pid=11265): Terminated: ok {rc=0} 11:01:53.483115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11267): Launched 11:01:53.790566 run osmo-hlr_10.42.42.2(pid=11268): Launched 11:01:53.907702 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:54.448782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11270): Launched 11:01:54.756684 run osmo-stp_10.42.42.5(pid=11271): Launched 11:01:54.873810 run osmo-msc_10.42.42.6: Starting osmo-msc 11:01:55.427525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11273): Launched 11:01:55.738166 run osmo-msc_10.42.42.6(pid=11274): Launched 11:01:55.910001 run osmo-stp_10.42.42.5(pid=11271): ERR: Terminated: ERROR {rc=1} [trial-2403↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11271)] 11:01:56.039825 run osmo-stp_10.42.42.5(pid=11271): stdout: | (launched: 2022-12-14_11:01:54.699832) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:56.170259 run osmo-stp_10.42.42.5(pid=11271): stderr: | 20221214110154867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110154868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110154868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110154868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110154869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110154869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110154869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:56.298151 run osmo-stp_10.42.42.5(pid=11271): stdout: | (launched: 2022-12-14_11:01:54.699832) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:56.419982 run osmo-stp_10.42.42.5(pid=11271): stderr: | 20221214110154867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110154868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110154868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110154868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110154869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110154869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110154869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:56.566115 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11271): Process ended prematurely: osmo-stp_10.42.42.5(pid=11271) [trial-2403↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11271)] [trial-2403↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 11:01:56.575264 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:01:56.602167 run osmo-hlr_10.42.42.2(pid=11268): ERR: Terminated: ERROR {rc=237} [trial-2403↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11268)] 11:01:56.650710 run osmo-hlr_10.42.42.2(pid=11268): stdout: | (launched: 2022-12-14_11:01:53.733976) 11:01:56.700776 run osmo-hlr_10.42.42.2(pid=11268): stderr: | 20221214110153908 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110153908 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110153908 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110153908 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110153908 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110153908 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110153921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110153929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110153929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110153929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:56.770789 run osmo-msc_10.42.42.6(pid=11274): ERR: Terminated: ERROR {rc=2} [trial-2403↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11274)] 11:01:56.818730 run osmo-msc_10.42.42.6(pid=11274): stdout: | (launched: 2022-12-14_11:01:55.680690) 11:01:56.868632 run osmo-msc_10.42.42.6(pid=11274): stderr: | 20221214110155949 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110155950 DLGLOBAL DEBUG validating counter group 0x7f2d61af6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110155950 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110155950 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110155950 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110155950 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110155952 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110155952 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110155952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110155952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:01:56.919216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11267): Terminating (SIGTERM) 11:01:56.959778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11270): Terminating (SIGTERM) 11:01:57.000036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11273): Terminating (SIGTERM) 11:01:57.040679 --- ParallelTerminationStrategy: PID 11267 died... 11:01:57.060458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11267): Terminated: ok {rc=0} 11:01:57.105408 --- ParallelTerminationStrategy: PID 11270 died... 11:01:57.124403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11270): Terminated: ok {rc=0} 11:01:57.169239 --- ParallelTerminationStrategy: PID 11273 died... 11:01:57.188414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11273): Terminated: ok {rc=0} 11:01:57.274191 bus /sierra_3: Setting Powered False 11:01:58.372373 bus /sierra_3: Setting Powered False 11:01:59.491236 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 emergency:nanobts+band-900 --------------------------------------------------------------------- 11:02:00.747486 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:02:00.754095 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 11:02:00.786279 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 11:02:00.813130 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 11:02:00.912689 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 11:02:00.952073 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 11:02:00.982119 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 11:02:01.605184 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2403 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 11:02:01.614624 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:02:01.631961 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 11:02:01.686245 tst emergency_mo_mt_call.py: using LAC 40475 11:02:01.825312 tst emergency_mo_mt_call.py: using RAC 185 11:02:01.947128 tst emergency_mo_mt_call.py: using CellId 40475 11:02:02.068938 tst emergency_mo_mt_call.py: using BVCI 40476 11:02:02.184421 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:02:02.196482 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:02:02.209338 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:02:02.221115 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:02:02.233989 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:02:02.246747 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:02.366127 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:02.481587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:02.949321 run create_hlr_db(pid=11279): Launched 11:02:03.064868 bus /sierra_2: Setting Powered False 11:02:04.126205 run create_hlr_db(pid=11279): Terminated: ok {rc=0} 11:02:04.570194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11281): Launched 11:02:04.894013 run osmo-hlr_10.42.42.2(pid=11282): Launched 11:02:05.018408 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:05.576509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11284): Launched 11:02:05.898925 run osmo-stp_10.42.42.5(pid=11285): Launched 11:02:06.034089 tst emergency_mo_mt_call.py: using MSISDN 8646 11:02:06.197835 run osmo-msc_10.42.42.6: Starting osmo-msc 11:02:06.776310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11287): Launched 11:02:07.100659 run osmo-msc_10.42.42.6(pid=11288): Launched 11:02:07.280557 run osmo-stp_10.42.42.5(pid=11285): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11285)] 11:02:07.416368 run osmo-stp_10.42.42.5(pid=11285): stdout: | (launched: 2022-12-14_11:02:05.839917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:07.553769 run osmo-stp_10.42.42.5(pid=11285): stderr: | 20221214110206030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110206030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110206030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110206031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110206032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110206032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110206032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:07.688873 run osmo-stp_10.42.42.5(pid=11285): stdout: | (launched: 2022-12-14_11:02:05.839917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:07.816711 run osmo-stp_10.42.42.5(pid=11285): stderr: | 20221214110206030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110206030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110206030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110206031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110206032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110206032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110206032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:07.969353 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=11285): Process ended prematurely: osmo-stp_10.42.42.5(pid=11285) [trial-2403↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11285)] [trial-2403↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 11:02:07.978702 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 11:02:08.006750 run osmo-hlr_10.42.42.2(pid=11282): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11282)] 11:02:08.057799 run osmo-hlr_10.42.42.2(pid=11282): stdout: | (launched: 2022-12-14_11:02:04.834874) 11:02:08.110229 run osmo-hlr_10.42.42.2(pid=11282): stderr: | 20221214110205031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110205031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110205031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110205031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110205031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110205031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110205044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110205054 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110205054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110205054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:08.183308 run osmo-msc_10.42.42.6(pid=11288): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11288)] 11:02:08.233778 run osmo-msc_10.42.42.6(pid=11288): stdout: | (launched: 2022-12-14_11:02:07.041137) 11:02:08.286040 run osmo-msc_10.42.42.6(pid=11288): stderr: | 20221214110207362 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110207362 DLGLOBAL DEBUG validating counter group 0x7f49c1c6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110207362 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110207362 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110207362 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110207362 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110207364 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110207365 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110207365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110207365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:02:08.338630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11281): Terminating (SIGTERM) 11:02:08.380834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11284): Terminating (SIGTERM) 11:02:08.423442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11287): Terminating (SIGTERM) 11:02:08.466585 --- ParallelTerminationStrategy: PID 11281 died... 11:02:08.486940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11281): Terminated: ok {rc=0} 11:02:08.533508 --- ParallelTerminationStrategy: PID 11284 died... 11:02:08.553301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11284): Terminated: ok {rc=0} 11:02:08.599546 --- ParallelTerminationStrategy: PID 11287 died... 11:02:08.619231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11287): Terminated: ok {rc=0} 11:02:08.709174 bus /sierra_3: Setting Powered False 11:02:09.810137 bus /sierra_3: Setting Powered False 11:02:10.926522 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 11:02:12.014599 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:02:12.026659 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 11:02:12.077598 tst emergency_preemptive_call.py: using LAC 40476 11:02:12.197328 tst emergency_preemptive_call.py: using RAC 186 11:02:12.314238 tst emergency_preemptive_call.py: using CellId 40476 11:02:12.431434 tst emergency_preemptive_call.py: using BVCI 40477 11:02:12.541782 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:02:12.552497 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:02:12.563107 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:02:12.573820 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:02:12.584655 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 11:02:12.595510 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:12.716098 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:12.834530 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:12.948119 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:13.067057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:13.567000 run create_hlr_db(pid=11290): Launched 11:02:13.698355 bus /sierra_2: Setting Powered False 11:02:14.762654 run create_hlr_db(pid=11290): Terminated: ok {rc=0} 11:02:15.194371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11292): Launched 11:02:15.497654 run osmo-hlr_10.42.42.2(pid=11293): Launched 11:02:15.613229 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:16.141732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11295): Launched 11:02:16.461728 run osmo-stp_10.42.42.5(pid=11296): Launched 11:02:16.716709 tst emergency_preemptive_call.py: using MSISDN 8647 11:02:16.924645 run osmo-msc_10.42.42.6: Starting osmo-msc 11:02:17.517599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11298): Launched 11:02:17.841047 run osmo-msc_10.42.42.6(pid=11299): Launched 11:02:18.022984 run osmo-stp_10.42.42.5(pid=11296): ERR: Terminated: ERROR {rc=1} [trial-2403↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11296)] 11:02:18.157900 run osmo-stp_10.42.42.5(pid=11296): stdout: | (launched: 2022-12-14_11:02:16.402314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:18.293524 run osmo-stp_10.42.42.5(pid=11296): stderr: | 20221214110216608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110216608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110216608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110216609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110216609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110216609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110216609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:18.428438 run osmo-stp_10.42.42.5(pid=11296): stdout: | (launched: 2022-12-14_11:02:16.402314) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:18.557222 run osmo-stp_10.42.42.5(pid=11296): stderr: | 20221214110216608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110216608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110216608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110216609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110216609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110216609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110216609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:18.711377 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=11296): Process ended prematurely: osmo-stp_10.42.42.5(pid=11296) [trial-2403↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11296)] [trial-2403↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 11:02:18.720677 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 11:02:18.748874 run osmo-hlr_10.42.42.2(pid=11293): ERR: Terminated: ERROR {rc=237} [trial-2403↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11293)] 11:02:18.800048 run osmo-hlr_10.42.42.2(pid=11293): stdout: | (launched: 2022-12-14_11:02:15.441961) 11:02:18.853185 run osmo-hlr_10.42.42.2(pid=11293): stderr: | 20221214110215616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110215616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110215616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110215616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110215616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110215616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110215627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110215636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110215636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110215636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:18.927068 run osmo-msc_10.42.42.6(pid=11299): ERR: Terminated: ERROR {rc=2} [trial-2403↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11299)] 11:02:18.977786 run osmo-msc_10.42.42.6(pid=11299): stdout: | (launched: 2022-12-14_11:02:17.781765) 11:02:19.030658 run osmo-msc_10.42.42.6(pid=11299): stderr: | 20221214110218101 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110218101 DLGLOBAL DEBUG validating counter group 0x7f0e213ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110218101 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110218101 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110218101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110218102 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110218103 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110218104 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110218104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110218104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:02:19.084347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11292): Terminating (SIGTERM) 11:02:19.126968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11295): Terminating (SIGTERM) 11:02:19.169684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11298): Terminating (SIGTERM) 11:02:19.212746 --- ParallelTerminationStrategy: PID 11292 died... 11:02:19.233245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11292): Terminated: ok {rc=0} 11:02:19.279852 --- ParallelTerminationStrategy: PID 11295 died... 11:02:19.299896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11295): Terminated: ok {rc=0} 11:02:19.346960 --- ParallelTerminationStrategy: PID 11298 died... 11:02:19.366915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11298): Terminated: ok {rc=0} 11:02:19.455743 bus /sierra_9: Setting Powered False 11:02:20.555733 bus /sierra_9: Setting Powered False 11:02:21.672624 bus /sierra_8: Setting Powered False 11:02:22.773392 bus /sierra_8: Setting Powered False 11:02:23.890292 bus /sierra_3: Setting Powered False 11:02:24.988746 bus /sierra_3: Setting Powered False 11:02:26.105384 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-900 --------------------------------------------------------------------- 11:02:27.382208 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:02:27.387621 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 11:02:27.419142 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 11:02:27.458418 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 11:02:27.547092 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 11:02:27.580434 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 11:02:27.620158 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 11:02:28.208862 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 11:02:28.261478 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:28.272183 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:02:28.318598 tst cs_paging_gprs_active.py: using LAC 40477 11:02:28.437380 tst cs_paging_gprs_active.py: using RAC 187 11:02:28.557659 tst cs_paging_gprs_active.py: using CellId 40477 11:02:28.685407 tst cs_paging_gprs_active.py: using BVCI 40478 11:02:28.804903 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:28.816703 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:28.828046 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:28.839385 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:28.850823 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:28.862245 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:28.873911 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:28.885355 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:28.896808 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:29.016107 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:29.139771 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:02:29.348497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:29.658223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11304): Launched 11:02:29.930983 run iperf3-srv_10.42.42.10(pid=11305): Launched 11:02:30.049322 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:02:30.255559 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:30.565138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11306): Launched 11:02:30.845770 run iperf3-srv_10.42.42.10(pid=11307): Launched 11:02:31.007225 tst cs_paging_gprs_active.py:38: start network... 11:02:31.272472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:31.798472 run create_hlr_db(pid=11308): Launched 11:02:31.945675 bus /sierra_2: Setting Powered False 11:02:33.006595 run create_hlr_db(pid=11308): Terminated: ok {rc=0} 11:02:33.471085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11310): Launched 11:02:33.801405 run osmo-hlr_10.42.42.2(pid=11311): Launched 11:02:33.927582 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:34.489218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11313): Launched 11:02:34.817436 run osmo-stp_10.42.42.5(pid=11314): Launched 11:02:34.943062 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:02:35.507905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11316): Launched 11:02:35.633890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:02:35.912172 run patchelf(pid=11317): Launched 11:02:36.095044 run osmo-stp_10.42.42.5(pid=11314): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11314)] 11:02:36.234888 run osmo-stp_10.42.42.5(pid=11314): stdout: | (launched: 2022-12-14_11:02:34.757223) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:36.375846 run osmo-stp_10.42.42.5(pid=11314): stderr: | 20221214110234946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110234946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110234946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110234947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110234947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110234947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110234947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:36.516409 run osmo-stp_10.42.42.5(pid=11314): stdout: | (launched: 2022-12-14_11:02:34.757223) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:36.650662 run osmo-stp_10.42.42.5(pid=11314): stderr: | 20221214110234946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110234946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110234946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110234947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110234947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110234947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110234947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:36.810782 run patchelf(pid=11317): Terminating (SIGINT) 11:02:36.995897 run patchelf(pid=11317): Terminated: ok {rc=0} 11:02:37.129647 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11314): Process ended prematurely: osmo-stp_10.42.42.5(pid=11314) [trial-2403↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11314)] [trial-2403↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 11:02:37.140287 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:02:37.169456 run osmo-hlr_10.42.42.2(pid=11311): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11311)] 11:02:37.220711 run osmo-hlr_10.42.42.2(pid=11311): stdout: | (launched: 2022-12-14_11:02:33.741308) 11:02:37.273535 run osmo-hlr_10.42.42.2(pid=11311): stderr: | 20221214110233936 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110233936 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110233936 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110233936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110233936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110233937 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110233948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110233958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110233959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110233959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:37.326425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11304): Terminating (SIGTERM) 11:02:37.369317 run iperf3-srv_10.42.42.10(pid=11305): Terminating (SIGTERM) 11:02:37.411890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11306): Terminating (SIGTERM) 11:02:37.454203 run iperf3-srv_10.42.42.10(pid=11307): Terminating (SIGTERM) 11:02:37.496639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11310): Terminating (SIGTERM) 11:02:37.539015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11313): Terminating (SIGTERM) 11:02:37.581461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11316): Terminating (SIGTERM) 11:02:37.623763 --- ParallelTerminationStrategy: PID 11304 died... 11:02:37.644067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11304): Terminated: ok {rc=0} 11:02:37.690968 --- ParallelTerminationStrategy: PID 11305 died... 11:02:37.710601 run iperf3-srv_10.42.42.10(pid=11305): Terminated {rc=256} 11:02:37.756864 --- ParallelTerminationStrategy: PID 11306 died... 11:02:37.777044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11306): Terminated: ok {rc=0} 11:02:37.823204 --- ParallelTerminationStrategy: PID 11307 died... 11:02:37.842831 run iperf3-srv_10.42.42.10(pid=11307): Terminated {rc=256} 11:02:37.888908 --- ParallelTerminationStrategy: PID 11310 died... 11:02:37.908647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11310): Terminated: ok {rc=0} 11:02:37.954890 --- ParallelTerminationStrategy: PID 11313 died... 11:02:37.974904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11313): Terminated: ok {rc=0} 11:02:38.021268 --- ParallelTerminationStrategy: PID 11316 died... 11:02:38.040789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11316): Terminated: ok {rc=0} 11:02:38.128942 bus /gobi_0: Setting Powered False 11:02:39.229846 bus /gobi_0: Setting Powered False 11:02:40.348043 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 11:02:41.494487 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:41.506046 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:02:41.557110 tst iperf3.py: using LAC 40478 11:02:41.686535 tst iperf3.py: using RAC 188 11:02:41.815046 tst iperf3.py: using CellId 40478 11:02:41.944732 tst iperf3.py: using BVCI 40479 11:02:42.063659 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:42.074951 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:42.085989 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:42.096937 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:42.108536 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:42.120196 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:42.131829 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:42.143144 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:42.154764 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:42.273689 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:02:42.480513 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:42.789870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11318): Launched 11:02:43.059212 run iperf3-srv_10.42.42.10(pid=11319): Launched 11:02:43.175353 tst iperf3.py:8: start network... 11:02:43.380663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:43.854926 run create_hlr_db(pid=11320): Launched 11:02:43.973452 bus /gobi_6: Setting Powered False 11:02:45.034285 run create_hlr_db(pid=11320): Terminated: ok {rc=0} 11:02:45.484694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11322): Launched 11:02:45.814246 run osmo-hlr_10.42.42.2(pid=11323): Launched 11:02:46.059121 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:46.689797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11325): Launched 11:02:47.017634 run osmo-stp_10.42.42.5(pid=11326): Launched 11:02:47.241541 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:02:47.789648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11328): Launched 11:02:47.907540 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:02:48.167049 run patchelf(pid=11329): Launched 11:02:48.339141 run osmo-stp_10.42.42.5(pid=11326): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11326)] 11:02:48.469725 run osmo-stp_10.42.42.5(pid=11326): stdout: | (launched: 2022-12-14_11:02:46.953937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:48.602018 run osmo-stp_10.42.42.5(pid=11326): stderr: | 20221214110247312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110247312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110247312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110247312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110247313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110247313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110247313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:48.734117 run osmo-stp_10.42.42.5(pid=11326): stdout: | (launched: 2022-12-14_11:02:46.953937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:48.860684 run osmo-stp_10.42.42.5(pid=11326): stderr: | 20221214110247312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110247312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110247312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110247312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110247313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110247313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110247313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:49.009658 run patchelf(pid=11329): Terminating (SIGINT) 11:02:49.182886 run patchelf(pid=11329): Terminated: ok {rc=0} 11:02:49.308480 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11326): Process ended prematurely: osmo-stp_10.42.42.5(pid=11326) [trial-2403↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11326)] [trial-2403↪gprs:nanobts+band-900↪iperf3.py:8] 11:02:49.318335 tst iperf3.py:8: Test FAILED (7.9 sec) 11:02:49.345953 run osmo-hlr_10.42.42.2(pid=11323): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11323)] 11:02:49.394846 run osmo-hlr_10.42.42.2(pid=11323): stdout: | (launched: 2022-12-14_11:02:45.754090) 11:02:49.444874 run osmo-hlr_10.42.42.2(pid=11323): stderr: | 20221214110246022 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110246023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110246023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110246023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110246023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110246023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110246042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110246057 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110246057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110246057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:49.495233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11318): Terminating (SIGTERM) 11:02:49.535916 run iperf3-srv_10.42.42.10(pid=11319): Terminating (SIGTERM) 11:02:49.576349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11322): Terminating (SIGTERM) 11:02:49.616639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11325): Terminating (SIGTERM) 11:02:49.656890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11328): Terminating (SIGTERM) 11:02:49.697539 --- ParallelTerminationStrategy: PID 11318 died... 11:02:49.717468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11318): Terminated: ok {rc=0} 11:02:49.761961 --- ParallelTerminationStrategy: PID 11319 died... 11:02:49.781273 run iperf3-srv_10.42.42.10(pid=11319): Terminated {rc=256} 11:02:49.825532 --- ParallelTerminationStrategy: PID 11322 died... 11:02:49.844833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11322): Terminated: ok {rc=0} 11:02:49.889108 --- ParallelTerminationStrategy: PID 11325 died... 11:02:49.908365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11325): Terminated: ok {rc=0} 11:02:49.952599 --- ParallelTerminationStrategy: PID 11328 died... 11:02:49.971929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11328): Terminated: ok {rc=0} 11:02:50.057956 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 11:02:51.206033 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:51.217585 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:02:51.266404 tst iperf3m4.py: using LAC 40479 11:02:51.395700 tst iperf3m4.py: using RAC 189 11:02:51.529614 tst iperf3m4.py: using CellId 40479 11:02:51.657175 tst iperf3m4.py: using BVCI 40480 11:02:51.771128 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:51.782056 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:51.792895 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:51.803737 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:51.815275 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:51.826910 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:51.838716 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:51.850143 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:02:51.861680 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:51.986121 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:52.106561 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:52.227847 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:02:52.349189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:02:52.569117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:52.898097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11330): Launched 11:02:53.183641 run iperf3-srv_10.42.42.10(pid=11331): Launched 11:02:53.307664 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:02:53.528426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:53.858193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11332): Launched 11:02:54.143904 run iperf3-srv_10.42.42.10(pid=11333): Launched 11:02:54.267640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:02:54.487878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:54.817632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11334): Launched 11:02:55.103646 run iperf3-srv_10.42.42.10(pid=11335): Launched 11:02:55.227930 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:02:55.448729 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:02:55.778685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11336): Launched 11:02:56.066165 run iperf3-srv_10.42.42.10(pid=11337): Launched 11:02:56.191271 tst iperf3m4.py:8: start network... 11:02:56.411666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:56.920408 run create_hlr_db(pid=11338): Launched 11:02:57.055027 bus /gobi_6: Setting Powered False 11:02:58.119801 run create_hlr_db(pid=11338): Terminated: ok {rc=0} 11:02:58.558939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11340): Launched 11:02:58.868204 run osmo-hlr_10.42.42.2(pid=11341): Launched 11:02:58.986817 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:59.528873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11343): Launched 11:02:59.839059 run osmo-stp_10.42.42.5(pid=11344): Launched 11:02:59.957489 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:00.485515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11346): Launched 11:03:00.605949 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:00.866865 run patchelf(pid=11347): Launched 11:03:01.067504 run osmo-stp_10.42.42.5(pid=11344): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11344)] 11:03:01.202208 run osmo-stp_10.42.42.5(pid=11344): stdout: | (launched: 2022-12-14_11:02:59.781843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:01.339003 run osmo-stp_10.42.42.5(pid=11344): stderr: | 20221214110259949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110259949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110259950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110259950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110259951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110259951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110259951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:01.475456 run osmo-stp_10.42.42.5(pid=11344): stdout: | (launched: 2022-12-14_11:02:59.781843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:01.605098 run osmo-stp_10.42.42.5(pid=11344): stderr: | 20221214110259949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110259949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110259950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110259950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110259951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110259951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110259951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:01.758133 run patchelf(pid=11347): Terminating (SIGINT) 11:03:01.936092 run patchelf(pid=11347): Terminated: ok {rc=0} 11:03:02.065055 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11344): Process ended prematurely: osmo-stp_10.42.42.5(pid=11344) [trial-2403↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11344)] [trial-2403↪gprs:nanobts+band-900↪iperf3m4.py:8] 11:03:02.076027 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:03:02.105330 run osmo-hlr_10.42.42.2(pid=11341): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11341)] 11:03:02.158368 run osmo-hlr_10.42.42.2(pid=11341): stdout: | (launched: 2022-12-14_11:02:58.809970) 11:03:02.209450 run osmo-hlr_10.42.42.2(pid=11341): stderr: | 20221214110258983 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110258983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110258983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110258983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110258984 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110258984 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110258996 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110259006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110259006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110259006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:02.263633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11330): Terminating (SIGTERM) 11:03:02.303827 run iperf3-srv_10.42.42.10(pid=11331): Terminating (SIGTERM) 11:03:02.344776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11332): Terminating (SIGTERM) 11:03:02.385694 run iperf3-srv_10.42.42.10(pid=11333): Terminating (SIGTERM) 11:03:02.426519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11334): Terminating (SIGTERM) 11:03:02.467450 run iperf3-srv_10.42.42.10(pid=11335): Terminating (SIGTERM) 11:03:02.508202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11336): Terminating (SIGTERM) 11:03:02.549127 run iperf3-srv_10.42.42.10(pid=11337): Terminating (SIGTERM) 11:03:02.589930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11340): Terminating (SIGTERM) 11:03:02.631010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11343): Terminating (SIGTERM) 11:03:02.671909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11346): Terminating (SIGTERM) 11:03:02.713259 --- ParallelTerminationStrategy: PID 11330 died... 11:03:02.733686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11330): Terminated: ok {rc=0} 11:03:02.778840 --- ParallelTerminationStrategy: PID 11331 died... 11:03:02.798608 run iperf3-srv_10.42.42.10(pid=11331): Terminated {rc=256} 11:03:02.843629 --- ParallelTerminationStrategy: PID 11332 died... 11:03:02.863208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11332): Terminated: ok {rc=0} 11:03:02.907952 --- ParallelTerminationStrategy: PID 11333 died... 11:03:02.927594 run iperf3-srv_10.42.42.10(pid=11333): Terminated {rc=256} 11:03:02.972313 --- ParallelTerminationStrategy: PID 11334 died... 11:03:02.991812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11334): Terminated: ok {rc=0} 11:03:03.036402 --- ParallelTerminationStrategy: PID 11335 died... 11:03:03.055923 run iperf3-srv_10.42.42.10(pid=11335): Terminated {rc=256} 11:03:03.100790 --- ParallelTerminationStrategy: PID 11336 died... 11:03:03.120872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11336): Terminated: ok {rc=0} 11:03:03.165665 --- ParallelTerminationStrategy: PID 11337 died... 11:03:03.185290 run iperf3-srv_10.42.42.10(pid=11337): Terminated {rc=256} 11:03:03.229831 --- ParallelTerminationStrategy: PID 11340 died... 11:03:03.249351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11340): Terminated: ok {rc=0} 11:03:03.294065 --- ParallelTerminationStrategy: PID 11343 died... 11:03:03.313614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11343): Terminated: ok {rc=0} 11:03:03.358421 --- ParallelTerminationStrategy: PID 11346 died... 11:03:03.378042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11346): Terminated: ok {rc=0} 11:03:03.465584 bus /gobi_4: Setting Powered False 11:03:04.565912 bus /gobi_4: Setting Powered False 11:03:05.681173 bus /gobi_1: Setting Powered False 11:03:06.782731 bus /gobi_1: Setting Powered False 11:03:07.900125 bus /gobi_0: Setting Powered False 11:03:08.999450 bus /gobi_0: Setting Powered False 11:03:10.118237 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900 ping.py ---------------------------------------------- 11:03:11.221708 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:11.233613 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:03:11.282609 tst ping.py: using LAC 40480 11:03:11.409226 tst ping.py: using RAC 190 11:03:11.538762 tst ping.py: using CellId 40480 11:03:11.665245 tst ping.py: using BVCI 40481 11:03:11.775873 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:11.786876 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:11.797751 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:11.808411 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:11.819518 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:11.830571 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:11.841587 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:11.852366 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:03:11.972718 tst ping.py:19: start network... 11:03:12.189598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:12.686260 run create_hlr_db(pid=11349): Launched 11:03:12.819185 bus /gobi_6: Setting Powered False 11:03:13.882915 run create_hlr_db(pid=11349): Terminated: ok {rc=0} 11:03:14.332698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11351): Launched 11:03:14.655721 run osmo-hlr_10.42.42.2(pid=11352): Launched 11:03:14.779347 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:15.337903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11354): Launched 11:03:15.661071 run osmo-stp_10.42.42.5(pid=11355): Launched 11:03:15.785856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:16.418086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11357): Launched 11:03:16.550433 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:16.822360 run patchelf(pid=11358): Launched 11:03:16.997459 run osmo-stp_10.42.42.5(pid=11355): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11355)] 11:03:17.130457 run osmo-stp_10.42.42.5(pid=11355): stdout: | (launched: 2022-12-14_11:03:15.601848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:17.264619 run osmo-stp_10.42.42.5(pid=11355): stderr: | 20221214110315792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110315792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110315792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110315793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110315793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110315793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110315793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:17.396266 run osmo-stp_10.42.42.5(pid=11355): stdout: | (launched: 2022-12-14_11:03:15.601848) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:17.520643 run osmo-stp_10.42.42.5(pid=11355): stderr: | 20221214110315792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110315792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110315792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110315793 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110315793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110315793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110315793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:17.667135 run patchelf(pid=11358): Terminating (SIGINT) 11:03:17.837694 run patchelf(pid=11358): Terminated: ok {rc=0} 11:03:17.960719 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11355): Process ended prematurely: osmo-stp_10.42.42.5(pid=11355) [trial-2403↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11355)] [trial-2403↪gprs:nanobts+band-900↪ping.py:22] 11:03:17.970188 tst ping.py:22: Test FAILED (6.7 sec) 11:03:17.997448 run osmo-hlr_10.42.42.2(pid=11352): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11352)] 11:03:18.046791 run osmo-hlr_10.42.42.2(pid=11352): stdout: | (launched: 2022-12-14_11:03:14.596188) 11:03:18.096843 run osmo-hlr_10.42.42.2(pid=11352): stderr: | 20221214110314790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110314790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110314790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110314791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110314791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110314791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110314804 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110314814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110314814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110314814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:18.148312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11351): Terminating (SIGTERM) 11:03:18.188625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11354): Terminating (SIGTERM) 11:03:18.229226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11357): Terminating (SIGTERM) 11:03:18.270338 --- ParallelTerminationStrategy: PID 11351 died... 11:03:18.290139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11351): Terminated: ok {rc=0} 11:03:18.334971 --- ParallelTerminationStrategy: PID 11354 died... 11:03:18.354421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11354): Terminated: ok {rc=0} 11:03:18.399051 --- ParallelTerminationStrategy: PID 11357 died... 11:03:18.418279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11357): Terminated: ok {rc=0} 11:03:18.504828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 11:03:19.592275 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:19.603545 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 11:03:19.655552 tst ping_idle_ping.py: using LAC 40481 11:03:19.786031 tst ping_idle_ping.py: using RAC 191 11:03:19.912344 tst ping_idle_ping.py: using CellId 40481 11:03:20.036876 tst ping_idle_ping.py: using BVCI 40482 11:03:20.154087 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:20.165813 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:20.177096 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:20.188304 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:20.199670 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:20.211047 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:20.222349 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 11:03:20.233618 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 11:03:20.349343 tst ping_idle_ping.py:24: start network... 11:03:20.552333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:21.023214 run create_hlr_db(pid=11359): Launched 11:03:21.140826 bus /gobi_6: Setting Powered False 11:03:22.202010 run create_hlr_db(pid=11359): Terminated: ok {rc=0} 11:03:22.646150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11361): Launched 11:03:22.972777 run osmo-hlr_10.42.42.2(pid=11362): Launched 11:03:23.097390 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:23.659272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11364): Launched 11:03:23.985310 run osmo-stp_10.42.42.5(pid=11365): Launched 11:03:24.109392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:24.666084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11367): Launched 11:03:24.792002 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:25.065181 run patchelf(pid=11368): Launched 11:03:25.246864 run osmo-stp_10.42.42.5(pid=11365): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11365)] 11:03:25.383435 run osmo-stp_10.42.42.5(pid=11365): stdout: | (launched: 2022-12-14_11:03:23.925434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:25.522259 run osmo-stp_10.42.42.5(pid=11365): stderr: | 20221214110324114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110324114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110324114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110324114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110324115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110324115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110324115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:25.661515 run osmo-stp_10.42.42.5(pid=11365): stdout: | (launched: 2022-12-14_11:03:23.925434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:25.794506 run osmo-stp_10.42.42.5(pid=11365): stderr: | 20221214110324114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110324114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110324114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110324114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110324115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110324115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110324115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:25.950071 run patchelf(pid=11368): Terminating (SIGINT) 11:03:26.131561 run patchelf(pid=11368): Terminated: ok {rc=0} 11:03:26.262546 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11365): Process ended prematurely: osmo-stp_10.42.42.5(pid=11365) [trial-2403↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11365)] [trial-2403↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 11:03:26.272199 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:03:26.301009 run osmo-hlr_10.42.42.2(pid=11362): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11362)] 11:03:26.351752 run osmo-hlr_10.42.42.2(pid=11362): stdout: | (launched: 2022-12-14_11:03:22.913136) 11:03:26.404050 run osmo-hlr_10.42.42.2(pid=11362): stderr: | 20221214110323110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110323110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110323110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110323110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110323110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110323110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110323123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110323131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110323131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110323131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:26.456899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11361): Terminating (SIGTERM) 11:03:26.499671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11364): Terminating (SIGTERM) 11:03:26.542571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11367): Terminating (SIGTERM) 11:03:26.585551 --- ParallelTerminationStrategy: PID 11361 died... 11:03:26.606160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11361): Terminated: ok {rc=0} 11:03:26.652922 --- ParallelTerminationStrategy: PID 11364 died... 11:03:26.673224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11364): Terminated: ok {rc=0} 11:03:26.720240 --- ParallelTerminationStrategy: PID 11367 died... 11:03:26.740132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11367): Terminated: ok {rc=0} 11:03:26.829904 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 11:03:28.138779 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:03:28.146000 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:03:28.177556 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:03:28.216694 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:03:28.304056 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:03:28.336878 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:03:28.375178 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:03:28.972170 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:03:29.021677 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.032542 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:03:29.080844 tst cs_paging_gprs_active.py: using LAC 40482 11:03:29.200550 tst cs_paging_gprs_active.py: using RAC 192 11:03:29.320491 tst cs_paging_gprs_active.py: using CellId 40482 11:03:29.442183 tst cs_paging_gprs_active.py: using BVCI 40483 11:03:29.554994 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.566024 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.576672 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.587776 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.598736 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.609861 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.620616 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.631905 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:29.643072 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:29.765562 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:29.884653 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:03:30.091888 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:30.401068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11372): Launched 11:03:30.669937 run iperf3-srv_10.42.42.10(pid=11373): Launched 11:03:30.788174 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:03:31.029489 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:31.372389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11374): Launched 11:03:31.660299 run iperf3-srv_10.42.42.10(pid=11375): Launched 11:03:31.803386 tst cs_paging_gprs_active.py:38: start network... 11:03:32.030475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:32.545284 run create_hlr_db(pid=11376): Launched 11:03:32.682360 bus /gobi_6: Setting Powered False 11:03:33.747687 run create_hlr_db(pid=11376): Terminated: ok {rc=0} 11:03:34.186238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11378): Launched 11:03:34.494981 run osmo-hlr_10.42.42.2(pid=11379): Launched 11:03:34.613147 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:35.143582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11381): Launched 11:03:35.455096 run osmo-stp_10.42.42.5(pid=11382): Launched 11:03:35.574829 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:36.105723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11384): Launched 11:03:36.225698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:36.486791 run patchelf(pid=11385): Launched 11:03:36.660802 run osmo-stp_10.42.42.5(pid=11382): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11382)] 11:03:36.792400 run osmo-stp_10.42.42.5(pid=11382): stdout: | (launched: 2022-12-14_11:03:35.397811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:36.925239 run osmo-stp_10.42.42.5(pid=11382): stderr: | 20221214110335567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110335567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110335567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110335568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110335568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110335568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110335568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:37.057795 run osmo-stp_10.42.42.5(pid=11382): stdout: | (launched: 2022-12-14_11:03:35.397811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:37.184434 run osmo-stp_10.42.42.5(pid=11382): stderr: | 20221214110335567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110335567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110335567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110335568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110335568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110335568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110335568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:37.334060 run patchelf(pid=11385): Terminating (SIGINT) 11:03:37.507989 run patchelf(pid=11385): Terminated: ok {rc=0} 11:03:37.633326 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11382): Process ended prematurely: osmo-stp_10.42.42.5(pid=11382) [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11382)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:03:37.643205 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:03:37.670998 run osmo-hlr_10.42.42.2(pid=11379): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11379)] 11:03:37.720274 run osmo-hlr_10.42.42.2(pid=11379): stdout: | (launched: 2022-12-14_11:03:34.437711) 11:03:37.770244 run osmo-hlr_10.42.42.2(pid=11379): stderr: | 20221214110334614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110334614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110334614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110334614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110334614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110334614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110334627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110334637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110334637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110334638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:37.820606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11372): Terminating (SIGTERM) 11:03:37.861055 run iperf3-srv_10.42.42.10(pid=11373): Terminating (SIGTERM) 11:03:37.901251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11374): Terminating (SIGTERM) 11:03:37.941997 run iperf3-srv_10.42.42.10(pid=11375): Terminating (SIGTERM) 11:03:37.982008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11378): Terminating (SIGTERM) 11:03:38.022229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11381): Terminating (SIGTERM) 11:03:38.062529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11384): Terminating (SIGTERM) 11:03:38.102997 --- ParallelTerminationStrategy: PID 11372 died... 11:03:38.122967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11372): Terminated: ok {rc=0} 11:03:38.167450 --- ParallelTerminationStrategy: PID 11373 died... 11:03:38.186653 run iperf3-srv_10.42.42.10(pid=11373): Terminated {rc=256} 11:03:38.230930 --- ParallelTerminationStrategy: PID 11374 died... 11:03:38.250252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11374): Terminated: ok {rc=0} 11:03:38.294780 --- ParallelTerminationStrategy: PID 11375 died... 11:03:38.313988 run iperf3-srv_10.42.42.10(pid=11375): Terminated {rc=256} 11:03:38.358415 --- ParallelTerminationStrategy: PID 11378 died... 11:03:38.377603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11378): Terminated: ok {rc=0} 11:03:38.422019 --- ParallelTerminationStrategy: PID 11381 died... 11:03:38.441249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11381): Terminated: ok {rc=0} 11:03:38.485564 --- ParallelTerminationStrategy: PID 11384 died... 11:03:38.504620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11384): Terminated: ok {rc=0} 11:03:38.589824 bus /gobi_0: Setting Powered False 11:03:39.690131 bus /gobi_0: Setting Powered False 11:03:40.818164 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:03:41.969143 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:41.981329 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:03:42.035106 tst iperf3.py: using LAC 40483 11:03:42.164873 tst iperf3.py: using RAC 193 11:03:42.294440 tst iperf3.py: using CellId 40483 11:03:42.424127 tst iperf3.py: using BVCI 40484 11:03:42.543204 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:42.554758 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:42.566068 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:42.577348 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:42.588436 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:42.599688 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:42.611189 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:42.622335 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:42.633722 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:42.754098 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:03:42.976873 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:43.306915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11386): Launched 11:03:43.594928 run iperf3-srv_10.42.42.10(pid=11387): Launched 11:03:43.720227 tst iperf3.py:8: start network... 11:03:43.942980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:44.452495 run create_hlr_db(pid=11388): Launched 11:03:44.587477 bus /gobi_6: Setting Powered False 11:03:45.651755 run create_hlr_db(pid=11388): Terminated: ok {rc=0} 11:03:46.122869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11390): Launched 11:03:46.487420 run osmo-hlr_10.42.42.2(pid=11391): Launched 11:03:46.738557 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:47.409362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11393): Launched 11:03:47.739653 run osmo-stp_10.42.42.5(pid=11394): Launched 11:03:47.865841 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:03:48.432504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11396): Launched 11:03:48.558782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:03:48.836788 run patchelf(pid=11397): Launched 11:03:49.021650 run osmo-stp_10.42.42.5(pid=11394): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11394)] 11:03:49.160448 run osmo-stp_10.42.42.5(pid=11394): stdout: | (launched: 2022-12-14_11:03:47.678424) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:49.301070 run osmo-stp_10.42.42.5(pid=11394): stderr: | 20221214110347869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110347869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110347870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110347870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110347870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110347871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110347871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:49.441701 run osmo-stp_10.42.42.5(pid=11394): stdout: | (launched: 2022-12-14_11:03:47.678424) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:49.575935 run osmo-stp_10.42.42.5(pid=11394): stderr: | 20221214110347869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110347869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110347870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110347870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110347870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110347871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110347871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:49.735858 run patchelf(pid=11397): Terminating (SIGINT) 11:03:49.921459 run patchelf(pid=11397): Terminated: ok {rc=0} 11:03:50.054894 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11394): Process ended prematurely: osmo-stp_10.42.42.5(pid=11394) [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11394)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 11:03:50.067526 tst iperf3.py:8: Test FAILED (8.1 sec) 11:03:50.096468 run osmo-hlr_10.42.42.2(pid=11391): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11391)] 11:03:50.147179 run osmo-hlr_10.42.42.2(pid=11391): stdout: | (launched: 2022-12-14_11:03:46.426698) 11:03:50.199501 run osmo-hlr_10.42.42.2(pid=11391): stderr: | 20221214110346727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110346728 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110346728 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110346728 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110346728 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110346728 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110346747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110346760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110346760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110346760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:50.252416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11386): Terminating (SIGTERM) 11:03:50.294868 run iperf3-srv_10.42.42.10(pid=11387): Terminating (SIGTERM) 11:03:50.337244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11390): Terminating (SIGTERM) 11:03:50.380001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11393): Terminating (SIGTERM) 11:03:50.422457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11396): Terminating (SIGTERM) 11:03:50.465277 --- ParallelTerminationStrategy: PID 11386 died... 11:03:50.485792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11386): Terminated: ok {rc=0} 11:03:50.532391 --- ParallelTerminationStrategy: PID 11387 died... 11:03:50.552305 run iperf3-srv_10.42.42.10(pid=11387): Terminated {rc=256} 11:03:50.598728 --- ParallelTerminationStrategy: PID 11390 died... 11:03:50.618665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11390): Terminated: ok {rc=0} 11:03:50.665214 --- ParallelTerminationStrategy: PID 11393 died... 11:03:50.685154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11393): Terminated: ok {rc=0} 11:03:50.732050 --- ParallelTerminationStrategy: PID 11396 died... 11:03:50.752009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11396): Terminated: ok {rc=0} 11:03:50.841436 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:03:51.992468 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:52.004545 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:03:52.058256 tst iperf3m4.py: using LAC 40484 11:03:52.189742 tst iperf3m4.py: using RAC 194 11:03:52.310372 tst iperf3m4.py: using CellId 40484 11:03:52.430691 tst iperf3m4.py: using BVCI 40485 11:03:52.543199 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:52.554465 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:52.565599 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:52.576453 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:52.587572 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:52.598618 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:52.610391 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:52.621448 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:03:52.632526 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:52.755164 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:52.876099 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:52.997809 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:03:53.116678 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:03:53.323143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:53.631713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11398): Launched 11:03:53.902295 run iperf3-srv_10.42.42.10(pid=11399): Launched 11:03:54.019499 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:03:54.224850 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:54.532903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11400): Launched 11:03:54.800903 run iperf3-srv_10.42.42.10(pid=11401): Launched 11:03:54.916288 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:03:55.122107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:55.431020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11402): Launched 11:03:55.700817 run iperf3-srv_10.42.42.10(pid=11403): Launched 11:03:55.815782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:03:56.020604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:03:56.328488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11404): Launched 11:03:56.597778 run iperf3-srv_10.42.42.10(pid=11405): Launched 11:03:56.714713 tst iperf3m4.py:8: start network... 11:03:56.920544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:03:57.395326 run create_hlr_db(pid=11406): Launched 11:03:57.512232 bus /gobi_6: Setting Powered False 11:03:58.573966 run create_hlr_db(pid=11406): Terminated: ok {rc=0} 11:03:59.003125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11408): Launched 11:03:59.314983 run osmo-hlr_10.42.42.2(pid=11409): Launched 11:03:59.432227 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:59.976694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11411): Launched 11:04:00.285943 run osmo-stp_10.42.42.5(pid=11412): Launched 11:04:00.404815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:04:00.944329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11414): Launched 11:04:01.087668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:04:01.375590 run patchelf(pid=11415): Launched 11:04:01.576257 run osmo-stp_10.42.42.5(pid=11412): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11412)] 11:04:01.719870 run osmo-stp_10.42.42.5(pid=11412): stdout: | (launched: 2022-12-14_11:04:00.228902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:01.866492 run osmo-stp_10.42.42.5(pid=11412): stderr: | 20221214110400400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110400400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110400400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110400400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110400401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110400401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110400401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:02.012600 run osmo-stp_10.42.42.5(pid=11412): stdout: | (launched: 2022-12-14_11:04:00.228902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:02.150732 run osmo-stp_10.42.42.5(pid=11412): stderr: | 20221214110400400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110400400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110400400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110400400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110400401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110400401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110400401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:02.312346 run patchelf(pid=11415): Terminating (SIGINT) 11:04:02.497097 run patchelf(pid=11415): Terminated: ok {rc=0} 11:04:02.630778 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11412): Process ended prematurely: osmo-stp_10.42.42.5(pid=11412) [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11412)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 11:04:02.641415 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:04:02.670938 run osmo-hlr_10.42.42.2(pid=11409): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11409)] 11:04:02.722264 run osmo-hlr_10.42.42.2(pid=11409): stdout: | (launched: 2022-12-14_11:03:59.257769) 11:04:02.775487 run osmo-hlr_10.42.42.2(pid=11409): stderr: | 20221214110359432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110359432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110359432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110359432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110359432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110359432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110359444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110359452 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110359453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110359453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:02.828717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11398): Terminating (SIGTERM) 11:04:02.871297 run iperf3-srv_10.42.42.10(pid=11399): Terminating (SIGTERM) 11:04:02.913909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11400): Terminating (SIGTERM) 11:04:02.956555 run iperf3-srv_10.42.42.10(pid=11401): Terminating (SIGTERM) 11:04:02.999003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11402): Terminating (SIGTERM) 11:04:03.042068 run iperf3-srv_10.42.42.10(pid=11403): Terminating (SIGTERM) 11:04:03.084382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11404): Terminating (SIGTERM) 11:04:03.126801 run iperf3-srv_10.42.42.10(pid=11405): Terminating (SIGTERM) 11:04:03.170398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11408): Terminating (SIGTERM) 11:04:03.212647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11411): Terminating (SIGTERM) 11:04:03.253270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11414): Terminating (SIGTERM) 11:04:03.294137 --- ParallelTerminationStrategy: PID 11398 died... 11:04:03.313993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11398): Terminated: ok {rc=0} 11:04:03.358911 --- ParallelTerminationStrategy: PID 11399 died... 11:04:03.378666 run iperf3-srv_10.42.42.10(pid=11399): Terminated {rc=256} 11:04:03.423311 --- ParallelTerminationStrategy: PID 11400 died... 11:04:03.442881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11400): Terminated: ok {rc=0} 11:04:03.487378 --- ParallelTerminationStrategy: PID 11401 died... 11:04:03.506854 run iperf3-srv_10.42.42.10(pid=11401): Terminated {rc=256} 11:04:03.551308 --- ParallelTerminationStrategy: PID 11402 died... 11:04:03.571265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11402): Terminated: ok {rc=0} 11:04:03.615792 --- ParallelTerminationStrategy: PID 11403 died... 11:04:03.635597 run iperf3-srv_10.42.42.10(pid=11403): Terminated {rc=256} 11:04:03.680354 --- ParallelTerminationStrategy: PID 11404 died... 11:04:03.700061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11404): Terminated: ok {rc=0} 11:04:03.744508 --- ParallelTerminationStrategy: PID 11405 died... 11:04:03.764077 run iperf3-srv_10.42.42.10(pid=11405): Terminated {rc=256} 11:04:03.808496 --- ParallelTerminationStrategy: PID 11408 died... 11:04:03.828189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11408): Terminated: ok {rc=0} 11:04:03.872787 --- ParallelTerminationStrategy: PID 11411 died... 11:04:03.893150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11411): Terminated: ok {rc=0} 11:04:03.937762 --- ParallelTerminationStrategy: PID 11414 died... 11:04:03.957290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11414): Terminated: ok {rc=0} 11:04:04.044383 bus /gobi_4: Setting Powered False 11:04:05.143903 bus /gobi_4: Setting Powered False 11:04:06.259194 bus /gobi_1: Setting Powered False 11:04:07.357509 bus /gobi_1: Setting Powered False 11:04:08.472440 bus /gobi_0: Setting Powered False 11:04:09.570257 bus /gobi_0: Setting Powered False 11:04:10.687233 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 11:04:11.791271 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:11.803459 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:04:11.855352 tst ping.py: using LAC 40485 11:04:11.987234 tst ping.py: using RAC 195 11:04:12.113834 tst ping.py: using CellId 40485 11:04:12.238955 tst ping.py: using BVCI 40486 11:04:12.357649 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:12.369241 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:12.380518 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:12.391900 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:12.403178 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:12.414500 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:12.426001 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:12.437280 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:04:12.556239 tst ping.py:19: start network... 11:04:12.773091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:13.269340 run create_hlr_db(pid=11416): Launched 11:04:13.400293 bus /gobi_6: Setting Powered False 11:04:14.464567 run create_hlr_db(pid=11416): Terminated: ok {rc=0} 11:04:14.897440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11418): Launched 11:04:15.199005 run osmo-hlr_10.42.42.2(pid=11419): Launched 11:04:15.315126 run osmo-stp_10.42.42.5: Starting osmo-stp 11:04:15.863572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11421): Launched 11:04:16.195034 run osmo-stp_10.42.42.5(pid=11422): Launched 11:04:16.474690 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:04:17.249786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11424): Launched 11:04:17.379062 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:04:17.635964 run patchelf(pid=11425): Launched 11:04:17.804678 run osmo-stp_10.42.42.5(pid=11422): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11422)] 11:04:17.932537 run osmo-stp_10.42.42.5(pid=11422): stdout: | (launched: 2022-12-14_11:04:16.138994) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:18.062810 run osmo-stp_10.42.42.5(pid=11422): stderr: | 20221214110416499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110416500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110416501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110416502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110416505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110416505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110416505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:18.192909 run osmo-stp_10.42.42.5(pid=11422): stdout: | (launched: 2022-12-14_11:04:16.138994) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:18.316257 run osmo-stp_10.42.42.5(pid=11422): stderr: | 20221214110416499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110416500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110416501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110416502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110416505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110416505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110416505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:18.462368 run patchelf(pid=11425): Terminating (SIGINT) 11:04:18.631638 run patchelf(pid=11425): Terminated: ok {rc=0} 11:04:18.753537 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11422): Process ended prematurely: osmo-stp_10.42.42.5(pid=11422) [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11422)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 11:04:18.762541 tst ping.py:22: Test FAILED (7.0 sec) 11:04:18.789576 run osmo-hlr_10.42.42.2(pid=11419): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11419)] 11:04:18.837611 run osmo-hlr_10.42.42.2(pid=11419): stdout: | (launched: 2022-12-14_11:04:15.143031) 11:04:18.887217 run osmo-hlr_10.42.42.2(pid=11419): stderr: | 20221214110415315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110415315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110415315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110415315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110415315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110415315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110415328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110415337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110415338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110415338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:18.937392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11418): Terminating (SIGTERM) 11:04:18.977293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11421): Terminating (SIGTERM) 11:04:19.017558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11424): Terminating (SIGTERM) 11:04:19.057643 --- ParallelTerminationStrategy: PID 11418 died... 11:04:19.077091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11418): Terminated: ok {rc=0} 11:04:19.121216 --- ParallelTerminationStrategy: PID 11421 died... 11:04:19.140135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11421): Terminated: ok {rc=0} 11:04:19.184017 --- ParallelTerminationStrategy: PID 11424 died... 11:04:19.203002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11424): Terminated: ok {rc=0} 11:04:19.288742 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:04:20.376931 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:20.388544 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:04:20.439042 tst ping_idle_ping.py: using LAC 40486 11:04:20.565761 tst ping_idle_ping.py: using RAC 196 11:04:20.691958 tst ping_idle_ping.py: using CellId 40486 11:04:20.819084 tst ping_idle_ping.py: using BVCI 40487 11:04:20.937455 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:20.949116 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:20.960584 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:20.972090 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:20.984121 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:20.995943 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:21.007977 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:04:21.019793 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:04:21.138098 tst ping_idle_ping.py:24: start network... 11:04:21.340359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:21.810428 run create_hlr_db(pid=11426): Launched 11:04:21.927341 bus /gobi_6: Setting Powered False 11:04:22.987789 run create_hlr_db(pid=11426): Terminated: ok {rc=0} 11:04:23.411530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11428): Launched 11:04:23.716100 run osmo-hlr_10.42.42.2(pid=11429): Launched 11:04:23.830860 run osmo-stp_10.42.42.5: Starting osmo-stp 11:04:24.364189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11431): Launched 11:04:24.667242 run osmo-stp_10.42.42.5(pid=11432): Launched 11:04:24.784422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:04:25.305776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11434): Launched 11:04:25.423375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:04:25.679042 run patchelf(pid=11435): Launched 11:04:25.849621 run osmo-stp_10.42.42.5(pid=11432): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11432)] 11:04:25.977136 run osmo-stp_10.42.42.5(pid=11432): stdout: | (launched: 2022-12-14_11:04:24.610923) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:26.107357 run osmo-stp_10.42.42.5(pid=11432): stderr: | 20221214110424779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110424779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110424780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110424780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110424781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110424781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110424781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:26.236768 run osmo-stp_10.42.42.5(pid=11432): stdout: | (launched: 2022-12-14_11:04:24.610923) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:26.360244 run osmo-stp_10.42.42.5(pid=11432): stderr: | 20221214110424779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110424779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110424780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110424780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110424781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110424781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110424781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:26.505961 run patchelf(pid=11435): Terminating (SIGINT) 11:04:26.676499 run patchelf(pid=11435): Terminated: ok {rc=0} 11:04:26.799199 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11432): Process ended prematurely: osmo-stp_10.42.42.5(pid=11432) [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11432)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 11:04:26.808390 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 11:04:26.835509 run osmo-hlr_10.42.42.2(pid=11429): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11429)] 11:04:26.883522 run osmo-hlr_10.42.42.2(pid=11429): stdout: | (launched: 2022-12-14_11:04:23.660093) 11:04:26.933245 run osmo-hlr_10.42.42.2(pid=11429): stderr: | 20221214110423835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110423835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110423835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110423835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110423835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110423835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110423848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110423857 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110423857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110423857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:26.983128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11428): Terminating (SIGTERM) 11:04:27.023318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11431): Terminating (SIGTERM) 11:04:27.063321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11434): Terminating (SIGTERM) 11:04:27.103618 --- ParallelTerminationStrategy: PID 11428 died... 11:04:27.123242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11428): Terminated: ok {rc=0} 11:04:27.167632 --- ParallelTerminationStrategy: PID 11431 died... 11:04:27.186484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11431): Terminated: ok {rc=0} 11:04:27.230764 --- ParallelTerminationStrategy: PID 11434 died... 11:04:27.249808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11434): Terminated: ok {rc=0} 11:04:27.336196 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:04:28.639222 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:04:28.645949 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:04:28.677662 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:04:28.716120 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:04:28.802337 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:04:28.834143 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:04:28.872327 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:04:29.466196 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:04:29.515483 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:29.526598 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:04:29.593611 tst cs_paging_gprs_active.py: using LAC 40487 11:04:29.722738 tst cs_paging_gprs_active.py: using RAC 197 11:04:29.851833 tst cs_paging_gprs_active.py: using CellId 40487 11:04:29.979642 tst cs_paging_gprs_active.py: using BVCI 40488 11:04:30.098964 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:30.110714 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:30.122062 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:30.133438 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:30.144530 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:30.155795 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:30.167752 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:30.179055 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:30.190639 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:30.313551 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:30.432326 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:04:30.637448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:30.965100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11441): Launched 11:04:31.289316 run iperf3-srv_10.42.42.10(pid=11442): Launched 11:04:31.427352 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:04:31.641235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:31.961037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11443): Launched 11:04:32.249834 run iperf3-srv_10.42.42.10(pid=11444): Launched 11:04:32.369305 tst cs_paging_gprs_active.py:38: start network... 11:04:32.573672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:33.049935 run create_hlr_db(pid=11445): Launched 11:04:33.170790 bus /gobi_6: Setting Powered False 11:04:34.231862 run create_hlr_db(pid=11445): Terminated: ok {rc=0} 11:04:34.682906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11447): Launched 11:04:35.015127 run osmo-hlr_10.42.42.2(pid=11448): Launched 11:04:35.141998 run osmo-stp_10.42.42.5: Starting osmo-stp 11:04:35.714527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11450): Launched 11:04:36.044535 run osmo-stp_10.42.42.5(pid=11451): Launched 11:04:36.172634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:04:36.740582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11453): Launched 11:04:36.867752 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:04:37.147766 run patchelf(pid=11454): Launched 11:04:37.333223 run osmo-stp_10.42.42.5(pid=11451): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11451)] 11:04:37.473264 run osmo-stp_10.42.42.5(pid=11451): stdout: | (launched: 2022-12-14_11:04:35.983856) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:37.614828 run osmo-stp_10.42.42.5(pid=11451): stderr: | 20221214110436175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110436175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110436176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110436176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110436177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110436177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110436177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:37.756637 run osmo-stp_10.42.42.5(pid=11451): stdout: | (launched: 2022-12-14_11:04:35.983856) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:37.891722 run osmo-stp_10.42.42.5(pid=11451): stderr: | 20221214110436175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110436175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110436176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110436176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110436177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110436177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110436177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:38.051888 run patchelf(pid=11454): Terminating (SIGINT) 11:04:38.238428 run patchelf(pid=11454): Terminated: ok {rc=0} 11:04:38.372034 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11451): Process ended prematurely: osmo-stp_10.42.42.5(pid=11451) [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11451)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:04:38.382510 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:04:38.411474 run osmo-hlr_10.42.42.2(pid=11448): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11448)] 11:04:38.462184 run osmo-hlr_10.42.42.2(pid=11448): stdout: | (launched: 2022-12-14_11:04:34.954641) 11:04:38.514719 run osmo-hlr_10.42.42.2(pid=11448): stderr: | 20221214110435150 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110435150 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110435150 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110435150 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110435150 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110435150 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110435163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110435172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110435172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110435172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:38.567670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11441): Terminating (SIGTERM) 11:04:38.610192 run iperf3-srv_10.42.42.10(pid=11442): Terminating (SIGTERM) 11:04:38.652908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11443): Terminating (SIGTERM) 11:04:38.695459 run iperf3-srv_10.42.42.10(pid=11444): Terminating (SIGTERM) 11:04:38.738035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11447): Terminating (SIGTERM) 11:04:38.780743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11450): Terminating (SIGTERM) 11:04:38.823755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11453): Terminating (SIGTERM) 11:04:38.866576 --- ParallelTerminationStrategy: PID 11441 died... 11:04:38.887336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11441): Terminated: ok {rc=0} 11:04:38.934589 --- ParallelTerminationStrategy: PID 11442 died... 11:04:38.954537 run iperf3-srv_10.42.42.10(pid=11442): Terminated {rc=256} 11:04:39.001425 --- ParallelTerminationStrategy: PID 11443 died... 11:04:39.021466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11443): Terminated: ok {rc=0} 11:04:39.068200 --- ParallelTerminationStrategy: PID 11444 died... 11:04:39.088145 run iperf3-srv_10.42.42.10(pid=11444): Terminated {rc=256} 11:04:39.134800 --- ParallelTerminationStrategy: PID 11447 died... 11:04:39.154757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11447): Terminated: ok {rc=0} 11:04:39.201356 --- ParallelTerminationStrategy: PID 11450 died... 11:04:39.221343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11450): Terminated: ok {rc=0} 11:04:39.267985 --- ParallelTerminationStrategy: PID 11453 died... 11:04:39.287991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11453): Terminated: ok {rc=0} 11:04:39.377641 bus /gobi_0: Setting Powered False 11:04:40.477335 bus /gobi_0: Setting Powered False 11:04:41.595203 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:04:42.745898 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:42.758553 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:04:42.830762 tst iperf3.py: using LAC 40488 11:04:42.960641 tst iperf3.py: using RAC 198 11:04:43.091267 tst iperf3.py: using CellId 40488 11:04:43.212665 tst iperf3.py: using BVCI 40489 11:04:43.323933 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:43.334943 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:43.345958 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:43.356679 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:43.367835 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:43.378922 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:43.390160 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:43.401235 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:43.412403 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:43.529804 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:04:43.735893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:44.043995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11455): Launched 11:04:44.313493 run iperf3-srv_10.42.42.10(pid=11456): Launched 11:04:44.431379 tst iperf3.py:8: start network... 11:04:44.636632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:45.112298 run create_hlr_db(pid=11457): Launched 11:04:45.230590 bus /gobi_6: Setting Powered False 11:04:46.294532 run create_hlr_db(pid=11457): Terminated: ok {rc=0} 11:04:46.800193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11459): Launched 11:04:47.129111 run osmo-hlr_10.42.42.2(pid=11460): Launched 11:04:47.303325 run osmo-stp_10.42.42.5: Starting osmo-stp 11:04:47.847255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11462): Launched 11:04:48.155405 run osmo-stp_10.42.42.5(pid=11463): Launched 11:04:48.274549 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:04:48.804428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11465): Launched 11:04:48.925755 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:04:49.186993 run patchelf(pid=11466): Launched 11:04:49.361149 run osmo-stp_10.42.42.5(pid=11463): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11463)] 11:04:49.491242 run osmo-stp_10.42.42.5(pid=11463): stdout: | (launched: 2022-12-14_11:04:48.098511) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:49.623304 run osmo-stp_10.42.42.5(pid=11463): stderr: | 20221214110448267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110448267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110448267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110448268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110448268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110448268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110448268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:49.754844 run osmo-stp_10.42.42.5(pid=11463): stdout: | (launched: 2022-12-14_11:04:48.098511) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:04:49.880721 run osmo-stp_10.42.42.5(pid=11463): stderr: | 20221214110448267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110448267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110448267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110448268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110448268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110448268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110448268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:04:50.029831 run patchelf(pid=11466): Terminating (SIGINT) 11:04:50.203339 run patchelf(pid=11466): Terminated: ok {rc=0} 11:04:50.329671 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11463): Process ended prematurely: osmo-stp_10.42.42.5(pid=11463) [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11463)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 11:04:50.339389 tst iperf3.py:8: Test FAILED (7.6 sec) 11:04:50.367114 run osmo-hlr_10.42.42.2(pid=11460): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11460)] 11:04:50.415554 run osmo-hlr_10.42.42.2(pid=11460): stdout: | (launched: 2022-12-14_11:04:47.071153) 11:04:50.465494 run osmo-hlr_10.42.42.2(pid=11460): stderr: | 20221214110447272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110447272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110447272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110447272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110447272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110447272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110447286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110447294 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110447294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110447294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:04:50.515844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11455): Terminating (SIGTERM) 11:04:50.556215 run iperf3-srv_10.42.42.10(pid=11456): Terminating (SIGTERM) 11:04:50.596466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11459): Terminating (SIGTERM) 11:04:50.636851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11462): Terminating (SIGTERM) 11:04:50.677028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11465): Terminating (SIGTERM) 11:04:50.717623 --- ParallelTerminationStrategy: PID 11455 died... 11:04:50.737505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11455): Terminated: ok {rc=0} 11:04:50.782121 --- ParallelTerminationStrategy: PID 11456 died... 11:04:50.801149 run iperf3-srv_10.42.42.10(pid=11456): Terminated {rc=256} 11:04:50.845619 --- ParallelTerminationStrategy: PID 11459 died... 11:04:50.864831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11459): Terminated: ok {rc=0} 11:04:50.909446 --- ParallelTerminationStrategy: PID 11462 died... 11:04:50.928656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11462): Terminated: ok {rc=0} 11:04:50.973304 --- ParallelTerminationStrategy: PID 11465 died... 11:04:50.992489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11465): Terminated: ok {rc=0} 11:04:51.079757 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:04:52.228806 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:52.240454 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:04:52.308495 tst iperf3m4.py: using LAC 40489 11:04:52.428729 tst iperf3m4.py: using RAC 199 11:04:52.549171 tst iperf3m4.py: using CellId 40489 11:04:52.671460 tst iperf3m4.py: using BVCI 40490 11:04:52.784208 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:52.795161 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:52.805962 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:52.816735 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:52.827844 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:52.838930 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:52.850111 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:52.861079 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:04:52.872282 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:52.995903 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:53.117246 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:53.238306 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:04:53.356734 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:04:53.564420 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:53.875753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11468): Launched 11:04:54.146157 run iperf3-srv_10.42.42.10(pid=11469): Launched 11:04:54.263982 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:04:54.470515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:54.779316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11470): Launched 11:04:55.050757 run iperf3-srv_10.42.42.10(pid=11471): Launched 11:04:55.166360 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:04:55.371740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:55.680584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11472): Launched 11:04:55.950156 run iperf3-srv_10.42.42.10(pid=11473): Launched 11:04:56.067563 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:04:56.273056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:04:56.583159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11474): Launched 11:04:56.853014 run iperf3-srv_10.42.42.10(pid=11475): Launched 11:04:56.968879 tst iperf3m4.py:8: start network... 11:04:57.175110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:04:57.650448 run create_hlr_db(pid=11476): Launched 11:04:57.769063 bus /gobi_6: Setting Powered False 11:04:58.829158 run create_hlr_db(pid=11476): Terminated: ok {rc=0} 11:04:59.258358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11478): Launched 11:04:59.567253 run osmo-hlr_10.42.42.2(pid=11479): Launched 11:04:59.684727 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:00.215522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11481): Launched 11:05:00.526615 run osmo-stp_10.42.42.5(pid=11482): Launched 11:05:00.644180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:05:01.178766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11484): Launched 11:05:01.310703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:05:01.575954 run patchelf(pid=11485): Launched 11:05:01.765620 run osmo-stp_10.42.42.5(pid=11482): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11482)] 11:05:01.910171 run osmo-stp_10.42.42.5(pid=11482): stdout: | (launched: 2022-12-14_11:05:00.469531) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:02.044927 run osmo-stp_10.42.42.5(pid=11482): stderr: | 20221214110500638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110500638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110500638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110500639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110500639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110500639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110500639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:02.179763 run osmo-stp_10.42.42.5(pid=11482): stdout: | (launched: 2022-12-14_11:05:00.469531) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:02.308125 run osmo-stp_10.42.42.5(pid=11482): stderr: | 20221214110500638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110500638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110500638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110500639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110500639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110500639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110500639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:02.458565 run patchelf(pid=11485): Terminating (SIGINT) 11:05:02.634799 run patchelf(pid=11485): Terminated: ok {rc=0} 11:05:02.759842 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11482): Process ended prematurely: osmo-stp_10.42.42.5(pid=11482) [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11482)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:05:02.769798 tst iperf3m4.py:8: Test FAILED (10.6 sec) 11:05:02.797651 run osmo-hlr_10.42.42.2(pid=11479): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11479)] 11:05:02.846595 run osmo-hlr_10.42.42.2(pid=11479): stdout: | (launched: 2022-12-14_11:04:59.510071) 11:05:02.896554 run osmo-hlr_10.42.42.2(pid=11479): stderr: | 20221214110459683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110459683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110459683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110459683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110459683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110459683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110459695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110459703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110459704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110459704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:02.947065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11468): Terminating (SIGTERM) 11:05:02.987639 run iperf3-srv_10.42.42.10(pid=11469): Terminating (SIGTERM) 11:05:03.028058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11470): Terminating (SIGTERM) 11:05:03.068400 run iperf3-srv_10.42.42.10(pid=11471): Terminating (SIGTERM) 11:05:03.108578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11472): Terminating (SIGTERM) 11:05:03.149034 run iperf3-srv_10.42.42.10(pid=11473): Terminating (SIGTERM) 11:05:03.189220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11474): Terminating (SIGTERM) 11:05:03.229880 run iperf3-srv_10.42.42.10(pid=11475): Terminating (SIGTERM) 11:05:03.269987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11478): Terminating (SIGTERM) 11:05:03.310277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11481): Terminating (SIGTERM) 11:05:03.350462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11484): Terminating (SIGTERM) 11:05:03.391143 --- ParallelTerminationStrategy: PID 11468 died... 11:05:03.410891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11468): Terminated: ok {rc=0} 11:05:03.455949 --- ParallelTerminationStrategy: PID 11469 died... 11:05:03.475137 run iperf3-srv_10.42.42.10(pid=11469): Terminated {rc=256} 11:05:03.519624 --- ParallelTerminationStrategy: PID 11470 died... 11:05:03.538876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11470): Terminated: ok {rc=0} 11:05:03.583516 --- ParallelTerminationStrategy: PID 11471 died... 11:05:03.602702 run iperf3-srv_10.42.42.10(pid=11471): Terminated {rc=256} 11:05:03.647120 --- ParallelTerminationStrategy: PID 11472 died... 11:05:03.666201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11472): Terminated: ok {rc=0} 11:05:03.710758 --- ParallelTerminationStrategy: PID 11473 died... 11:05:03.729896 run iperf3-srv_10.42.42.10(pid=11473): Terminated {rc=256} 11:05:03.774466 --- ParallelTerminationStrategy: PID 11474 died... 11:05:03.793677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11474): Terminated: ok {rc=0} 11:05:03.838035 --- ParallelTerminationStrategy: PID 11475 died... 11:05:03.857193 run iperf3-srv_10.42.42.10(pid=11475): Terminated {rc=256} 11:05:03.901729 --- ParallelTerminationStrategy: PID 11478 died... 11:05:03.921058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11478): Terminated: ok {rc=0} 11:05:03.965575 --- ParallelTerminationStrategy: PID 11481 died... 11:05:03.984593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11481): Terminated: ok {rc=0} 11:05:04.029413 --- ParallelTerminationStrategy: PID 11484 died... 11:05:04.048328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11484): Terminated: ok {rc=0} 11:05:04.135982 bus /gobi_4: Setting Powered False 11:05:05.236111 bus /gobi_4: Setting Powered False 11:05:06.353022 bus /gobi_1: Setting Powered False 11:05:07.453861 bus /gobi_1: Setting Powered False 11:05:08.571583 bus /gobi_0: Setting Powered False 11:05:09.666649 bus /gobi_0: Setting Powered False 11:05:10.783504 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:05:11.887218 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:11.899053 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:05:11.966241 tst ping.py: using LAC 40490 11:05:12.084780 tst ping.py: using RAC 200 11:05:12.202509 tst ping.py: using CellId 40490 11:05:12.321373 tst ping.py: using BVCI 40491 11:05:12.430994 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:12.442301 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:12.453366 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:12.464226 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:12.475386 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:12.486608 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:12.497911 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:12.509111 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:05:12.625713 tst ping.py:19: start network... 11:05:12.828245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:13.294020 run create_hlr_db(pid=11489): Launched 11:05:13.411214 bus /gobi_6: Setting Powered False 11:05:14.471345 run create_hlr_db(pid=11489): Terminated: ok {rc=0} 11:05:14.895844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11491): Launched 11:05:15.199517 run osmo-hlr_10.42.42.2(pid=11492): Launched 11:05:15.316637 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:15.853685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11494): Launched 11:05:16.205719 run osmo-stp_10.42.42.5(pid=11495): Launched 11:05:16.347345 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:05:17.041726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11497): Launched 11:05:17.167551 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:05:17.430050 run patchelf(pid=11498): Launched 11:05:17.600268 run osmo-stp_10.42.42.5(pid=11495): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11495)] 11:05:17.728641 run osmo-stp_10.42.42.5(pid=11495): stdout: | (launched: 2022-12-14_11:05:16.145606) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:17.859236 run osmo-stp_10.42.42.5(pid=11495): stderr: | 20221214110516464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110516464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110516464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110516465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110516465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110516465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110516465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:17.988872 run osmo-stp_10.42.42.5(pid=11495): stdout: | (launched: 2022-12-14_11:05:16.145606) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:18.112720 run osmo-stp_10.42.42.5(pid=11495): stderr: | 20221214110516464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110516464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110516464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110516465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110516465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110516465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110516465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:18.259430 run patchelf(pid=11498): Terminating (SIGINT) 11:05:18.429506 run patchelf(pid=11498): Terminated: ok {rc=0} 11:05:18.552837 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11495): Process ended prematurely: osmo-stp_10.42.42.5(pid=11495) [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11495)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 11:05:18.562170 tst ping.py:22: Test FAILED (6.7 sec) 11:05:18.589162 run osmo-hlr_10.42.42.2(pid=11492): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11492)] 11:05:18.637477 run osmo-hlr_10.42.42.2(pid=11492): stdout: | (launched: 2022-12-14_11:05:15.143463) 11:05:18.687435 run osmo-hlr_10.42.42.2(pid=11492): stderr: | 20221214110515323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110515323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110515323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110515323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110515323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110515324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110515335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110515343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110515344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110515344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:18.737673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11491): Terminating (SIGTERM) 11:05:18.777979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11494): Terminating (SIGTERM) 11:05:18.818101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11497): Terminating (SIGTERM) 11:05:18.858875 --- ParallelTerminationStrategy: PID 11491 died... 11:05:18.878622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11491): Terminated: ok {rc=0} 11:05:18.922997 --- ParallelTerminationStrategy: PID 11494 died... 11:05:18.942000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11494): Terminated: ok {rc=0} 11:05:18.986394 --- ParallelTerminationStrategy: PID 11497 died... 11:05:19.005583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11497): Terminated: ok {rc=0} 11:05:19.092387 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:05:20.182493 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:20.194318 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:05:20.262644 tst ping_idle_ping.py: using LAC 40491 11:05:20.382241 tst ping_idle_ping.py: using RAC 201 11:05:20.502638 tst ping_idle_ping.py: using CellId 40491 11:05:20.622262 tst ping_idle_ping.py: using BVCI 40492 11:05:20.733416 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:20.744366 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:20.755269 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:20.766135 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:20.777365 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:20.788528 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:20.799835 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:05:20.811055 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:05:20.927584 tst ping_idle_ping.py:24: start network... 11:05:21.131579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:21.603360 run create_hlr_db(pid=11499): Launched 11:05:21.718320 bus /gobi_6: Setting Powered False 11:05:22.779220 run create_hlr_db(pid=11499): Terminated: ok {rc=0} 11:05:23.204316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11501): Launched 11:05:23.507309 run osmo-hlr_10.42.42.2(pid=11502): Launched 11:05:23.623978 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:24.159312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11504): Launched 11:05:24.463485 run osmo-stp_10.42.42.5(pid=11505): Launched 11:05:24.579744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:05:25.101708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11507): Launched 11:05:25.217965 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:05:25.474186 run patchelf(pid=11508): Launched 11:05:25.645196 run osmo-stp_10.42.42.5(pid=11505): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11505)] 11:05:25.773630 run osmo-stp_10.42.42.5(pid=11505): stdout: | (launched: 2022-12-14_11:05:24.406722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:25.903932 run osmo-stp_10.42.42.5(pid=11505): stderr: | 20221214110524577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110524577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110524577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110524578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110524578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110524578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110524578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:26.034405 run osmo-stp_10.42.42.5(pid=11505): stdout: | (launched: 2022-12-14_11:05:24.406722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:26.158269 run osmo-stp_10.42.42.5(pid=11505): stderr: | 20221214110524577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110524577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110524577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110524578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110524578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110524578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110524578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:26.305302 run patchelf(pid=11508): Terminating (SIGINT) 11:05:26.475605 run patchelf(pid=11508): Terminated: ok {rc=0} 11:05:26.598955 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11505): Process ended prematurely: osmo-stp_10.42.42.5(pid=11505) [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11505)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:05:26.608056 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 11:05:26.635162 run osmo-hlr_10.42.42.2(pid=11502): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11502)] 11:05:26.683430 run osmo-hlr_10.42.42.2(pid=11502): stdout: | (launched: 2022-12-14_11:05:23.451057) 11:05:26.733403 run osmo-hlr_10.42.42.2(pid=11502): stderr: | 20221214110523625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110523625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110523625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110523625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110523625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110523625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110523637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110523646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110523646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110523646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:26.783767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11501): Terminating (SIGTERM) 11:05:26.824186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11504): Terminating (SIGTERM) 11:05:26.864501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11507): Terminating (SIGTERM) 11:05:26.904874 --- ParallelTerminationStrategy: PID 11501 died... 11:05:26.924683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11501): Terminated: ok {rc=0} 11:05:26.969408 --- ParallelTerminationStrategy: PID 11504 died... 11:05:26.988625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11504): Terminated: ok {rc=0} 11:05:27.033361 --- ParallelTerminationStrategy: PID 11507 died... 11:05:27.052612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11507): Terminated: ok {rc=0} 11:05:27.139093 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:05:28.450734 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:05:28.457948 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:05:28.489368 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 11:05:28.528403 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 11:05:28.614546 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:05:28.646139 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 11:05:28.684040 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 11:05:29.289972 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 11:05:29.342853 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:29.354869 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:05:29.405295 tst cs_paging_gprs_active.py: using LAC 40492 11:05:29.531112 tst cs_paging_gprs_active.py: using RAC 202 11:05:29.662995 tst cs_paging_gprs_active.py: using CellId 40492 11:05:29.781364 tst cs_paging_gprs_active.py: using BVCI 40493 11:05:29.891267 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:29.902603 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:29.914023 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:29.925358 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:29.936852 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:29.948228 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:29.959685 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:29.970932 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:29.982622 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:05:30.101175 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:05:30.221228 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:05:30.438762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:05:30.764392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11512): Launched 11:05:31.068208 run iperf3-srv_10.42.42.10(pid=11513): Launched 11:05:31.213637 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:05:31.424803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:05:31.744002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11514): Launched 11:05:32.030512 run iperf3-srv_10.42.42.10(pid=11515): Launched 11:05:32.154561 tst cs_paging_gprs_active.py:38: start network... 11:05:32.366589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:32.839573 run create_hlr_db(pid=11516): Launched 11:05:32.955524 bus /gobi_6: Setting Powered False 11:05:34.015261 run create_hlr_db(pid=11516): Terminated: ok {rc=0} 11:05:34.438436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11518): Launched 11:05:34.743006 run osmo-hlr_10.42.42.2(pid=11519): Launched 11:05:34.860408 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:35.395862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11521): Launched 11:05:35.698989 run osmo-stp_10.42.42.5(pid=11522): Launched 11:05:35.816264 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:05:36.347210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11524): Launched 11:05:36.464087 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:05:36.721335 run patchelf(pid=11525): Launched 11:05:36.890923 run osmo-stp_10.42.42.5(pid=11522): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11522)] 11:05:37.020299 run osmo-stp_10.42.42.5(pid=11522): stdout: | (launched: 2022-12-14_11:05:35.643110) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:37.150608 run osmo-stp_10.42.42.5(pid=11522): stderr: | 20221214110535811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110535811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110535812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110535812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110535812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110535812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110535813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:37.280596 run osmo-stp_10.42.42.5(pid=11522): stdout: | (launched: 2022-12-14_11:05:35.643110) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:37.404910 run osmo-stp_10.42.42.5(pid=11522): stderr: | 20221214110535811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110535811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110535812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110535812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110535812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110535812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110535813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:37.552517 run patchelf(pid=11525): Terminating (SIGINT) 11:05:37.723463 run patchelf(pid=11525): Terminated: ok {rc=0} 11:05:37.846855 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11522): Process ended prematurely: osmo-stp_10.42.42.5(pid=11522) [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11522)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 11:05:37.856573 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:05:37.884032 run osmo-hlr_10.42.42.2(pid=11519): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11519)] 11:05:37.932870 run osmo-hlr_10.42.42.2(pid=11519): stdout: | (launched: 2022-12-14_11:05:34.686714) 11:05:37.983382 run osmo-hlr_10.42.42.2(pid=11519): stderr: | 20221214110534858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110534858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110534858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110534858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110534858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110534858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110534873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110534881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110534882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110534882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:38.033791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11512): Terminating (SIGTERM) 11:05:38.074200 run iperf3-srv_10.42.42.10(pid=11513): Terminating (SIGTERM) 11:05:38.114516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11514): Terminating (SIGTERM) 11:05:38.154630 run iperf3-srv_10.42.42.10(pid=11515): Terminating (SIGTERM) 11:05:38.194999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11518): Terminating (SIGTERM) 11:05:38.235473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11521): Terminating (SIGTERM) 11:05:38.275652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11524): Terminating (SIGTERM) 11:05:38.316045 --- ParallelTerminationStrategy: PID 11512 died... 11:05:38.335639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11512): Terminated: ok {rc=0} 11:05:38.379818 --- ParallelTerminationStrategy: PID 11513 died... 11:05:38.398663 run iperf3-srv_10.42.42.10(pid=11513): Terminated {rc=256} 11:05:38.442533 --- ParallelTerminationStrategy: PID 11514 died... 11:05:38.461540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11514): Terminated: ok {rc=0} 11:05:38.505567 --- ParallelTerminationStrategy: PID 11515 died... 11:05:38.524473 run iperf3-srv_10.42.42.10(pid=11515): Terminated {rc=256} 11:05:38.569090 --- ParallelTerminationStrategy: PID 11518 died... 11:05:38.587966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11518): Terminated: ok {rc=0} 11:05:38.631574 --- ParallelTerminationStrategy: PID 11521 died... 11:05:38.650723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11521): Terminated: ok {rc=0} 11:05:38.694665 --- ParallelTerminationStrategy: PID 11524 died... 11:05:38.713860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11524): Terminated: ok {rc=0} 11:05:38.800436 bus /gobi_0: Setting Powered False 11:05:39.900482 bus /gobi_0: Setting Powered False 11:05:41.012354 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 11:05:42.154721 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:42.166837 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:05:42.217782 tst iperf3.py: using LAC 40493 11:05:42.346300 tst iperf3.py: using RAC 203 11:05:42.474036 tst iperf3.py: using CellId 40493 11:05:42.601439 tst iperf3.py: using BVCI 40494 11:05:42.721187 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:42.733049 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:42.744711 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:42.756512 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:42.769330 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:42.781860 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:42.794316 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:42.806483 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:42.818909 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:05:42.941339 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:05:43.143314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:05:43.447139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11526): Launched 11:05:43.711919 run iperf3-srv_10.42.42.10(pid=11527): Launched 11:05:43.825861 tst iperf3.py:8: start network... 11:05:44.026466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:44.493562 run create_hlr_db(pid=11528): Launched 11:05:44.610598 bus /gobi_6: Setting Powered False 11:05:45.670516 run create_hlr_db(pid=11528): Terminated: ok {rc=0} 11:05:46.124275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11530): Launched 11:05:46.469480 run osmo-hlr_10.42.42.2(pid=11531): Launched 11:05:46.643846 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:47.386497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11533): Launched 11:05:47.702053 run osmo-stp_10.42.42.5(pid=11534): Launched 11:05:47.817256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:05:48.341381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11536): Launched 11:05:48.458267 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:05:48.715042 run patchelf(pid=11537): Launched 11:05:48.885068 run osmo-stp_10.42.42.5(pid=11534): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11534)] 11:05:49.013504 run osmo-stp_10.42.42.5(pid=11534): stdout: | (launched: 2022-12-14_11:05:47.645817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:49.144132 run osmo-stp_10.42.42.5(pid=11534): stderr: | 20221214110547814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110547814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110547814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110547815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110547815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110547815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110547816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:49.274645 run osmo-stp_10.42.42.5(pid=11534): stdout: | (launched: 2022-12-14_11:05:47.645817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:49.399159 run osmo-stp_10.42.42.5(pid=11534): stderr: | 20221214110547814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110547814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110547814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110547815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110547815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110547815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110547816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:49.546091 run patchelf(pid=11537): Terminating (SIGINT) 11:05:49.717217 run patchelf(pid=11537): Terminated: ok {rc=0} 11:05:49.840940 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11534): Process ended prematurely: osmo-stp_10.42.42.5(pid=11534) [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11534)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 11:05:49.850709 tst iperf3.py:8: Test FAILED (7.7 sec) 11:05:49.877984 run osmo-hlr_10.42.42.2(pid=11531): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11531)] 11:05:49.926626 run osmo-hlr_10.42.42.2(pid=11531): stdout: | (launched: 2022-12-14_11:05:46.408284) 11:05:49.976743 run osmo-hlr_10.42.42.2(pid=11531): stderr: | 20221214110546799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110546799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110546799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110546799 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110546799 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110546799 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110546819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110546835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110546835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110546835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:50.027425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11526): Terminating (SIGTERM) 11:05:50.067624 run iperf3-srv_10.42.42.10(pid=11527): Terminating (SIGTERM) 11:05:50.107635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11530): Terminating (SIGTERM) 11:05:50.147677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11533): Terminating (SIGTERM) 11:05:50.188149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11536): Terminating (SIGTERM) 11:05:50.228288 --- ParallelTerminationStrategy: PID 11526 died... 11:05:50.247901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11526): Terminated: ok {rc=0} 11:05:50.292134 --- ParallelTerminationStrategy: PID 11527 died... 11:05:50.311118 run iperf3-srv_10.42.42.10(pid=11527): Terminated {rc=256} 11:05:50.355130 --- ParallelTerminationStrategy: PID 11530 died... 11:05:50.374187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11530): Terminated: ok {rc=0} 11:05:50.418391 --- ParallelTerminationStrategy: PID 11533 died... 11:05:50.437510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11533): Terminated: ok {rc=0} 11:05:50.481647 --- ParallelTerminationStrategy: PID 11536 died... 11:05:50.500531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11536): Terminated: ok {rc=0} 11:05:50.587476 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 11:05:51.735367 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:51.747841 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:05:51.805704 tst iperf3m4.py: using LAC 40494 11:05:51.924342 tst iperf3m4.py: using RAC 204 11:05:52.050798 tst iperf3m4.py: using CellId 40494 11:05:52.172601 tst iperf3m4.py: using BVCI 40495 11:05:52.281641 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:52.292917 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:52.304131 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:52.315319 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:52.326864 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:52.338387 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:52.349902 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:52.361207 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:05:52.372759 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:05:52.494074 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:05:52.614324 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:05:52.736189 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:05:52.858888 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:05:53.080014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:05:53.406229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11541): Launched 11:05:53.690477 run iperf3-srv_10.42.42.10(pid=11542): Launched 11:05:53.813874 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:05:54.031872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:05:54.358328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11543): Launched 11:05:54.641309 run iperf3-srv_10.42.42.10(pid=11544): Launched 11:05:54.764132 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:05:54.982933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:05:55.308294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11545): Launched 11:05:55.593514 run iperf3-srv_10.42.42.10(pid=11546): Launched 11:05:55.714625 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:05:55.932550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:05:56.257952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11547): Launched 11:05:56.540292 run iperf3-srv_10.42.42.10(pid=11548): Launched 11:05:56.663900 tst iperf3m4.py:8: start network... 11:05:56.882670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:57.386778 run create_hlr_db(pid=11549): Launched 11:05:57.518412 bus /gobi_6: Setting Powered False 11:05:58.582467 run create_hlr_db(pid=11549): Terminated: ok {rc=0} 11:05:59.018853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11551): Launched 11:05:59.323201 run osmo-hlr_10.42.42.2(pid=11552): Launched 11:05:59.439649 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:59.978058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11554): Launched 11:06:00.282580 run osmo-stp_10.42.42.5(pid=11555): Launched 11:06:00.398585 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:06:00.944938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11557): Launched 11:06:01.075678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:06:01.337539 run patchelf(pid=11558): Launched 11:06:01.522786 run osmo-stp_10.42.42.5(pid=11555): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11555)] 11:06:01.655992 run osmo-stp_10.42.42.5(pid=11555): stdout: | (launched: 2022-12-14_11:06:00.226203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:01.789914 run osmo-stp_10.42.42.5(pid=11555): stderr: | 20221214110600394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110600394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110600395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110600395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110600395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110600395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110600396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:01.924019 run osmo-stp_10.42.42.5(pid=11555): stdout: | (launched: 2022-12-14_11:06:00.226203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:02.052152 run osmo-stp_10.42.42.5(pid=11555): stderr: | 20221214110600394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110600394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110600395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110600395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110600395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110600395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110600396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:02.203921 run patchelf(pid=11558): Terminating (SIGINT) 11:06:02.378467 run patchelf(pid=11558): Terminated: ok {rc=0} 11:06:02.502105 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11555): Process ended prematurely: osmo-stp_10.42.42.5(pid=11555) [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11555)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 11:06:02.511909 tst iperf3m4.py:8: Test FAILED (10.8 sec) 11:06:02.539718 run osmo-hlr_10.42.42.2(pid=11552): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11552)] 11:06:02.588238 run osmo-hlr_10.42.42.2(pid=11552): stdout: | (launched: 2022-12-14_11:05:59.267217) 11:06:02.638262 run osmo-hlr_10.42.42.2(pid=11552): stderr: | 20221214110559440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110559440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110559440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110559440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110559440 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110559440 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110559452 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110559461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110559461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110559461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:02.688661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11541): Terminating (SIGTERM) 11:06:02.728826 run iperf3-srv_10.42.42.10(pid=11542): Terminating (SIGTERM) 11:06:02.768864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11543): Terminating (SIGTERM) 11:06:02.809142 run iperf3-srv_10.42.42.10(pid=11544): Terminating (SIGTERM) 11:06:02.849456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11545): Terminating (SIGTERM) 11:06:02.889664 run iperf3-srv_10.42.42.10(pid=11546): Terminating (SIGTERM) 11:06:02.929597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11547): Terminating (SIGTERM) 11:06:02.969675 run iperf3-srv_10.42.42.10(pid=11548): Terminating (SIGTERM) 11:06:03.009586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11551): Terminating (SIGTERM) 11:06:03.049696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11554): Terminating (SIGTERM) 11:06:03.089775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11557): Terminating (SIGTERM) 11:06:03.130230 --- ParallelTerminationStrategy: PID 11541 died... 11:06:03.149800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11541): Terminated: ok {rc=0} 11:06:03.194263 --- ParallelTerminationStrategy: PID 11542 died... 11:06:03.213162 run iperf3-srv_10.42.42.10(pid=11542): Terminated {rc=256} 11:06:03.257472 --- ParallelTerminationStrategy: PID 11543 died... 11:06:03.276589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11543): Terminated: ok {rc=0} 11:06:03.320922 --- ParallelTerminationStrategy: PID 11544 died... 11:06:03.340450 run iperf3-srv_10.42.42.10(pid=11544): Terminated {rc=256} 11:06:03.384895 --- ParallelTerminationStrategy: PID 11545 died... 11:06:03.404320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11545): Terminated: ok {rc=0} 11:06:03.449215 --- ParallelTerminationStrategy: PID 11546 died... 11:06:03.468467 run iperf3-srv_10.42.42.10(pid=11546): Terminated {rc=256} 11:06:03.513038 --- ParallelTerminationStrategy: PID 11547 died... 11:06:03.532436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11547): Terminated: ok {rc=0} 11:06:03.576895 --- ParallelTerminationStrategy: PID 11548 died... 11:06:03.596401 run iperf3-srv_10.42.42.10(pid=11548): Terminated {rc=256} 11:06:03.640895 --- ParallelTerminationStrategy: PID 11551 died... 11:06:03.660422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11551): Terminated: ok {rc=0} 11:06:03.704841 --- ParallelTerminationStrategy: PID 11554 died... 11:06:03.724296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11554): Terminated: ok {rc=0} 11:06:03.769183 --- ParallelTerminationStrategy: PID 11557 died... 11:06:03.788280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11557): Terminated: ok {rc=0} 11:06:03.873522 bus /gobi_4: Setting Powered False 11:06:04.973967 bus /gobi_4: Setting Powered False 11:06:06.090558 bus /gobi_1: Setting Powered False 11:06:07.189923 bus /gobi_1: Setting Powered False 11:06:08.306679 bus /gobi_0: Setting Powered False 11:06:09.404629 bus /gobi_0: Setting Powered False 11:06:10.521771 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 11:06:11.622243 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:11.634217 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:06:11.685115 tst ping.py: using LAC 40495 11:06:11.810414 tst ping.py: using RAC 205 11:06:11.934743 tst ping.py: using CellId 40495 11:06:12.058505 tst ping.py: using BVCI 40496 11:06:12.174178 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:12.186229 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:12.198051 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:12.209940 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:12.221637 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:12.233493 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:12.245414 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:12.257184 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:06:12.372618 tst ping.py:19: start network... 11:06:12.572640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:13.033827 run create_hlr_db(pid=11559): Launched 11:06:13.148035 bus /gobi_6: Setting Powered False 11:06:14.207578 run create_hlr_db(pid=11559): Terminated: ok {rc=0} 11:06:14.627167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11561): Launched 11:06:14.927240 run osmo-hlr_10.42.42.2(pid=11562): Launched 11:06:15.041518 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:15.568210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11564): Launched 11:06:15.870685 run osmo-stp_10.42.42.5(pid=11565): Launched 11:06:16.091218 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:06:16.826087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11567): Launched 11:06:16.956104 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:06:17.215172 run patchelf(pid=11568): Launched 11:06:17.416305 run osmo-stp_10.42.42.5(pid=11565): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11565)] 11:06:17.552000 run osmo-stp_10.42.42.5(pid=11565): stdout: | (launched: 2022-12-14_11:06:15.811655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:17.689924 run osmo-stp_10.42.42.5(pid=11565): stderr: | 20221214110616102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110616102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110616103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110616103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110616103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110616103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110616104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:17.827818 run osmo-stp_10.42.42.5(pid=11565): stdout: | (launched: 2022-12-14_11:06:15.811655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:17.958622 run osmo-stp_10.42.42.5(pid=11565): stderr: | 20221214110616102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110616102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110616103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110616103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110616103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110616103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110616104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:18.113788 run patchelf(pid=11568): Terminating (SIGINT) 11:06:18.293654 run patchelf(pid=11568): Terminated: ok {rc=0} 11:06:18.423527 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11565): Process ended prematurely: osmo-stp_10.42.42.5(pid=11565) [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11565)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 11:06:18.433542 tst ping.py:22: Test FAILED (6.8 sec) 11:06:18.462466 run osmo-hlr_10.42.42.2(pid=11562): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11562)] 11:06:18.513622 run osmo-hlr_10.42.42.2(pid=11562): stdout: | (launched: 2022-12-14_11:06:14.871209) 11:06:18.567013 run osmo-hlr_10.42.42.2(pid=11562): stderr: | 20221214110615045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110615046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110615046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110615046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110615046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110615046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110615058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110615068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110615068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110615068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:18.620321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11561): Terminating (SIGTERM) 11:06:18.663510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11564): Terminating (SIGTERM) 11:06:18.706846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11567): Terminating (SIGTERM) 11:06:18.749978 --- ParallelTerminationStrategy: PID 11561 died... 11:06:18.770788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11561): Terminated: ok {rc=0} 11:06:18.818473 --- ParallelTerminationStrategy: PID 11564 died... 11:06:18.838585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11564): Terminated: ok {rc=0} 11:06:18.885703 --- ParallelTerminationStrategy: PID 11567 died... 11:06:18.905786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11567): Terminated: ok {rc=0} 11:06:18.995465 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 11:06:20.084305 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:20.097200 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:06:20.149459 tst ping_idle_ping.py: using LAC 40496 11:06:20.274624 tst ping_idle_ping.py: using RAC 206 11:06:20.401178 tst ping_idle_ping.py: using CellId 40496 11:06:20.527632 tst ping_idle_ping.py: using BVCI 40497 11:06:20.643034 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:20.655139 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:20.666886 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:20.678686 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:20.690364 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:20.702803 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:20.714839 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:06:20.726728 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:06:20.847273 tst ping_idle_ping.py:24: start network... 11:06:21.062526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:21.558836 run create_hlr_db(pid=11569): Launched 11:06:21.690458 bus /gobi_6: Setting Powered False 11:06:22.753885 run create_hlr_db(pid=11569): Terminated: ok {rc=0} 11:06:23.203105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11571): Launched 11:06:23.523661 run osmo-hlr_10.42.42.2(pid=11572): Launched 11:06:23.647008 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:24.200330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11574): Launched 11:06:24.519380 run osmo-stp_10.42.42.5(pid=11575): Launched 11:06:24.641741 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:06:25.192321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11577): Launched 11:06:25.315331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:06:25.583803 run patchelf(pid=11578): Launched 11:06:25.761827 run osmo-stp_10.42.42.5(pid=11575): ERR: Terminated: ERROR {rc=1} [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11575)] 11:06:25.897568 run osmo-stp_10.42.42.5(pid=11575): stdout: | (launched: 2022-12-14_11:06:24.460212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:26.035039 run osmo-stp_10.42.42.5(pid=11575): stderr: | 20221214110624649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110624649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110624649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110624650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110624650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110624650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110624650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:26.172025 run osmo-stp_10.42.42.5(pid=11575): stdout: | (launched: 2022-12-14_11:06:24.460212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:26.303259 run osmo-stp_10.42.42.5(pid=11575): stderr: | 20221214110624649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110624649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110624649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110624650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110624650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110624650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110624650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:26.458234 run patchelf(pid=11578): Terminating (SIGINT) 11:06:26.637021 run patchelf(pid=11578): Terminated: ok {rc=0} 11:06:26.766176 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11575): Process ended prematurely: osmo-stp_10.42.42.5(pid=11575) [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11575)] [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 11:06:26.775927 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:06:26.804923 run osmo-hlr_10.42.42.2(pid=11572): ERR: Terminated: ERROR {rc=237} [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11572)] 11:06:26.855522 run osmo-hlr_10.42.42.2(pid=11572): stdout: | (launched: 2022-12-14_11:06:23.465078) 11:06:26.907896 run osmo-hlr_10.42.42.2(pid=11572): stderr: | 20221214110623659 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110623659 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110623659 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110623659 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110623659 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110623659 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110623672 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110623680 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110623680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110623680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:26.960797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11571): Terminating (SIGTERM) 11:06:27.002906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11574): Terminating (SIGTERM) 11:06:27.045661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11577): Terminating (SIGTERM) 11:06:27.088718 --- ParallelTerminationStrategy: PID 11571 died... 11:06:27.109331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11571): Terminated: ok {rc=0} 11:06:27.156092 --- ParallelTerminationStrategy: PID 11574 died... 11:06:27.175990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11574): Terminated: ok {rc=0} 11:06:27.222804 --- ParallelTerminationStrategy: PID 11577 died... 11:06:27.242786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11577): Terminated: ok {rc=0} 11:06:27.331368 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 11:06:28.655298 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:28.663602 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:06:28.696313 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:06:28.732402 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:06:28.789511 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:06:28.823291 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:06:28.859467 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:06:29.418268 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2403 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:06:29.423838 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:06:29.435943 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:06:29.506376 tst switch_tch_pdch.py: using LAC 40497 11:06:29.630962 tst switch_tch_pdch.py: using RAC 207 11:06:29.757139 tst switch_tch_pdch.py: using CellId 40497 11:06:29.882549 tst switch_tch_pdch.py: using BVCI 40498 11:06:29.997569 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:06:30.009629 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:06:30.021585 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:06:30.033464 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:06:30.045963 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:06:30.058488 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:06:30.071049 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:06:30.083422 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:06:30.202034 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:06:30.325223 tst switch_tch_pdch.py:51: start network... 11:06:30.541619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:31.049886 run create_hlr_db(pid=11582): Launched 11:06:31.213388 bus /gobi_6: Setting Powered False 11:06:32.290469 run create_hlr_db(pid=11582): Terminated: ok {rc=0} 11:06:32.736502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11584): Launched 11:06:33.055161 run osmo-hlr_10.42.42.2(pid=11585): Launched 11:06:33.178244 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:33.730837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11587): Launched 11:06:34.051691 run osmo-stp_10.42.42.5(pid=11588): Launched 11:06:34.172208 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:06:34.725303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11590): Launched 11:06:34.847832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:06:35.116355 run patchelf(pid=11591): Launched 11:06:35.294353 run osmo-stp_10.42.42.5(pid=11588): ERR: Terminated: ERROR {rc=1} [trial-2403↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11588)] 11:06:35.429580 run osmo-stp_10.42.42.5(pid=11588): stdout: | (launched: 2022-12-14_11:06:33.993353) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:35.566885 run osmo-stp_10.42.42.5(pid=11588): stderr: | 20221214110634183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110634183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110634183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110634184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110634184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110634184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110634184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:35.704045 run osmo-stp_10.42.42.5(pid=11588): stdout: | (launched: 2022-12-14_11:06:33.993353) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:35.834841 run osmo-stp_10.42.42.5(pid=11588): stderr: | 20221214110634183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110634183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110634183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110634184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110634184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110634184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110634184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:35.989309 run patchelf(pid=11591): Terminating (SIGINT) 11:06:36.168094 run patchelf(pid=11591): Terminated: ok {rc=0} 11:06:36.297124 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11588): Process ended prematurely: osmo-stp_10.42.42.5(pid=11588) [trial-2403↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11588)] [trial-2403↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:06:36.307044 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 11:06:36.335588 run osmo-hlr_10.42.42.2(pid=11585): ERR: Terminated: ERROR {rc=237} [trial-2403↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11585)] 11:06:36.386259 run osmo-hlr_10.42.42.2(pid=11585): stdout: | (launched: 2022-12-14_11:06:32.996480) 11:06:36.438834 run osmo-hlr_10.42.42.2(pid=11585): stderr: | 20221214110633193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110633193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110633193 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110633193 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110633193 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110633193 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110633206 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110633214 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110633214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110633214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:36.491853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11584): Terminating (SIGTERM) 11:06:36.534621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11587): Terminating (SIGTERM) 11:06:36.577219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11590): Terminating (SIGTERM) 11:06:36.620378 --- ParallelTerminationStrategy: PID 11584 died... 11:06:36.640832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11584): Terminated: ok {rc=0} 11:06:36.687775 --- ParallelTerminationStrategy: PID 11587 died... 11:06:36.707607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11587): Terminated: ok {rc=0} 11:06:36.754081 --- ParallelTerminationStrategy: PID 11590 died... 11:06:36.773962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11590): Terminated: ok {rc=0} 11:06:36.862731 bus /gobi_0: Setting Powered False 11:06:37.963063 bus /gobi_0: Setting Powered False 11:06:39.080060 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2403 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 nitb_smpp --------------------------------------------------------------------- 11:06:40.339290 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:40.342166 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 11:06:40.363284 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 11:06:40.370882 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 11:06:40.407392 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 11:06:40.428393 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 11:06:40.435116 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 11:06:40.959747 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2403 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 11:06:40.966481 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:06:40.986068 tst esme_connect_policy_acceptall.py: using MSISDN 8648 11:06:41.120479 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:06:41.691198 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11595): Launched 11:06:41.997464 run osmo-nitb_10.42.42.2(pid=11596): Launched 11:06:42.167664 run osmo-nitb_10.42.42.2(pid=11596): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11596)] 11:06:42.305370 run osmo-nitb_10.42.42.2(pid=11596): stdout: | (launched: 2022-12-14_11:06:41.941466) 11:06:42.444297 run osmo-nitb_10.42.42.2(pid=11596): stderr: | (launched: 2022-12-14_11:06:41.986626) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:06:42.583620 run osmo-nitb_10.42.42.2(pid=11596): stdout: | (launched: 2022-12-14_11:06:41.941466) 11:06:42.717416 run osmo-nitb_10.42.42.2(pid=11596): stderr: | (launched: 2022-12-14_11:06:41.986626) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11596): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11596) [trial-2403↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11596)] 11:06:43.114109 tst osmo-nitb_10.42.42.2(pid=11596): stdout: | (launched: 2022-12-14_11:06:41.941466) 11:06:43.238978 tst osmo-nitb_10.42.42.2(pid=11596): stderr: | (launched: 2022-12-14_11:06:41.986626) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:06:43.384769 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=11596): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11596) [trial-2403↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11596)] [trial-2403↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 11:06:43.393367 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 11:06:43.400022 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11595): Terminating (SIGTERM) 11:06:43.610818 --- ParallelTerminationStrategy: PID 11595 died... 11:06:43.631868 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11595): Terminated: ok {rc=0} ---------------------------------------------- trial-2403 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 11:06:43.681843 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:06:43.703401 tst esme_connect_policy_closed.py: using MSISDN 8649 11:06:43.826910 tst esme_connect_policy_closed.py: using MSISDN 8650 11:06:43.938531 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:06:44.508812 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11597): Launched 11:06:44.817092 run osmo-nitb_10.42.42.2(pid=11598): Launched 11:06:44.982411 run osmo-nitb_10.42.42.2(pid=11598): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11598)] 11:06:45.108424 run osmo-nitb_10.42.42.2(pid=11598): stdout: | (launched: 2022-12-14_11:06:44.760515) 11:06:45.235930 run osmo-nitb_10.42.42.2(pid=11598): stderr: | (launched: 2022-12-14_11:06:44.806234) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:06:45.363365 run osmo-nitb_10.42.42.2(pid=11598): stdout: | (launched: 2022-12-14_11:06:44.760515) 11:06:45.484355 run osmo-nitb_10.42.42.2(pid=11598): stderr: | (launched: 2022-12-14_11:06:44.806234) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:06:45.630063 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=11598): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11598) [trial-2403↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11598)] [trial-2403↪nitb_smpp↪esme_connect_policy_closed.py:24] 11:06:45.638581 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 11:06:45.645260 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11597): Terminating (SIGTERM) 11:06:45.854207 --- ParallelTerminationStrategy: PID 11597 died... 11:06:45.878668 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11597): Terminated: ok {rc=0} ---------------------------------------------- trial-2403 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 11:06:45.941861 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:06:45.954112 tst nitb_smpp: Using 1 x bts (candidates: 1) 11:06:45.991356 tst esme_ms_sms_storeforward.py: using LAC 40498 11:06:46.148526 tst esme_ms_sms_storeforward.py: using RAC 208 11:06:46.283215 tst esme_ms_sms_storeforward.py: using CellId 40498 11:06:46.407514 tst esme_ms_sms_storeforward.py: using BVCI 40499 11:06:46.530973 tst nitb_smpp: Using 1 x modem (candidates: 1) 11:06:46.694376 tst esme_ms_sms_storeforward.py: using MSISDN 8651 11:06:46.844609 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 11:06:47.115397 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:06:47.794231 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11599): Launched 11:06:48.125685 run osmo-nitb_10.42.42.2(pid=11600): Launched 11:06:48.305208 run osmo-nitb_10.42.42.2(pid=11600): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11600)] 11:06:48.440644 run osmo-nitb_10.42.42.2(pid=11600): stdout: | (launched: 2022-12-14_11:06:48.065532) 11:06:48.577660 run osmo-nitb_10.42.42.2(pid=11600): stderr: | (launched: 2022-12-14_11:06:48.114518) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:06:48.714335 run osmo-nitb_10.42.42.2(pid=11600): stdout: | (launched: 2022-12-14_11:06:48.065532) 11:06:48.845671 run osmo-nitb_10.42.42.2(pid=11600): stderr: | (launched: 2022-12-14_11:06:48.114518) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:06:49.002464 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=11600): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11600) [trial-2403↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11600)] [trial-2403↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 11:06:49.011613 tst esme_ms_sms_storeforward.py:23: Test FAILED (3.1 sec) 11:06:49.018838 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11599): Terminating (SIGTERM) 11:06:49.229673 --- ParallelTerminationStrategy: PID 11599 died... 11:06:49.251987 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11599): Terminated: ok {rc=0} 11:06:49.342163 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 11:06:50.430589 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:06:50.442480 tst nitb_smpp: Using 1 x bts (candidates: 1) 11:06:50.479495 tst esme_ms_sms_transaction.py: using LAC 40499 11:06:50.609326 tst esme_ms_sms_transaction.py: using RAC 209 11:06:50.737408 tst esme_ms_sms_transaction.py: using CellId 40499 11:06:50.865831 tst esme_ms_sms_transaction.py: using BVCI 40500 11:06:50.986100 tst nitb_smpp: Using 1 x modem (candidates: 1) 11:06:51.118119 tst esme_ms_sms_transaction.py: using MSISDN 8652 11:06:51.238332 tst esme_ms_sms_transaction.py:18: start nitb and bts... 11:06:51.459048 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:06:52.123302 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11601): Launched 11:06:52.451951 run osmo-nitb_10.42.42.2(pid=11602): Launched 11:06:52.633432 run osmo-nitb_10.42.42.2(pid=11602): ERR: Terminated: ERROR {rc=2} [trial-2403↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11602)] 11:06:52.780786 run osmo-nitb_10.42.42.2(pid=11602): stdout: | (launched: 2022-12-14_11:06:52.392239) 11:06:52.930090 run osmo-nitb_10.42.42.2(pid=11602): stderr: | (launched: 2022-12-14_11:06:52.440797) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:06:53.078348 run osmo-nitb_10.42.42.2(pid=11602): stdout: | (launched: 2022-12-14_11:06:52.392239) 11:06:53.220385 run osmo-nitb_10.42.42.2(pid=11602): stderr: | (launched: 2022-12-14_11:06:52.440797) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11602): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11602) [trial-2403↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11602)] 11:06:53.575528 tst osmo-nitb_10.42.42.2(pid=11602): stdout: | (launched: 2022-12-14_11:06:52.392239) 11:06:53.707238 tst osmo-nitb_10.42.42.2(pid=11602): stderr: | (launched: 2022-12-14_11:06:52.440797) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:06:53.863040 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=11602): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11602) [trial-2403↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11602)] [trial-2403↪nitb_smpp↪esme_ms_sms_transaction.py:21] 11:06:53.872386 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 11:06:53.879481 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11601): Terminating (SIGTERM) 11:06:54.090560 --- ParallelTerminationStrategy: PID 11601 died... 11:06:54.112533 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11601): Terminated: ok {rc=0} 11:06:54.202458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 smpp --------------------------------------------------------------------- 11:06:55.374661 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:55.377771 tst smpp: Verifying 1 x bts (candidates: 11) 11:06:55.398892 tst smpp: Verifying 6 x ip_address (candidates: 9) 11:06:55.426132 tst smpp: Verifying 1 x modem (candidates: 12) 11:06:55.461923 tst smpp: Reserving 1 x bts (candidates: 11) 11:06:55.483166 tst smpp: Reserving 6 x ip_address (candidates: 9) 11:06:55.510008 tst smpp: Reserving 1 x modem (candidates: 12) 11:06:56.039760 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2403 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 11:06:56.045118 tst smpp: Using 1 x ip_address (candidates: 6) 11:06:56.055970 tst smpp: Using 1 x ip_address (candidates: 6) 11:06:56.066787 tst smpp: Using 1 x ip_address (candidates: 6) 11:06:56.077684 tst smpp: Using 1 x ip_address (candidates: 6) 11:06:56.096520 tst esme_connect_policy_acceptall.py: using MSISDN 8653 11:06:56.215611 run osmo-stp_10.42.42.4: Starting osmo-stp 11:06:56.775233 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11608): Launched 11:06:57.102791 run osmo-stp_10.42.42.4(pid=11609): Launched 11:06:57.229913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:57.738963 run create_hlr_db(pid=11610): Launched 11:06:57.873557 bus /sierra_2: Setting Powered False 11:06:58.938393 run create_hlr_db(pid=11610): Terminated: ok {rc=0} 11:06:59.378509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11612): Launched 11:06:59.688118 run osmo-hlr_10.42.42.2(pid=11613): Launched 11:06:59.806051 run osmo-msc_10.42.42.5: Starting osmo-msc 11:07:00.370024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11615): Launched 11:07:00.679587 run osmo-msc_10.42.42.5(pid=11616): Launched 11:07:00.884781 run osmo-hlr_10.42.42.2(pid=11613): ERR: Terminated: ERROR {rc=237} [trial-2403↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11613)] 11:07:01.072180 run osmo-hlr_10.42.42.2(pid=11613): stdout: | (launched: 2022-12-14_11:06:59.631386) 11:07:01.321485 run osmo-hlr_10.42.42.2(pid=11613): stderr: | 20221214110659806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110659806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110659806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110659806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110659806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110659806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110659822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110659832 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110659832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110659832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:01.479773 run osmo-hlr_10.42.42.2(pid=11613): stdout: | (launched: 2022-12-14_11:06:59.631386) 11:07:01.617903 run osmo-hlr_10.42.42.2(pid=11613): stderr: | 20221214110659806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110659806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110659806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110659806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110659806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110659806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110659822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110659832 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110659832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110659832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:01.780425 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=11613): Process ended prematurely: osmo-hlr_10.42.42.2(pid=11613) [trial-2403↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11613)] [trial-2403↪smpp↪esme_connect_policy_acceptall.py:23] 11:07:01.790835 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.7 sec) 11:07:01.820561 run osmo-msc_10.42.42.5(pid=11616): ERR: Terminated: ERROR {rc=9} [trial-2403↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=11616)] 11:07:01.874649 run osmo-msc_10.42.42.5(pid=11616): stdout: | (launched: 2022-12-14_11:07:00.621959) 11:07:01.929399 run osmo-msc_10.42.42.5(pid=11616): stderr: | 20221214110701047 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221214110701047 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221214110701047 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110701047 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221214110701047 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221214110701047 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221214110701047 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221214110701048 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214110701048 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 11:07:01.985068 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11608): Terminating (SIGTERM) 11:07:02.029506 run osmo-stp_10.42.42.4(pid=11609): Terminating (SIGTERM) 11:07:02.080735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11612): Terminating (SIGTERM) 11:07:02.173339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11615): Terminating (SIGTERM) 11:07:02.244906 --- ParallelTerminationStrategy: PID 11608 died... 11:07:02.265459 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11608): Terminated: ok {rc=0} 11:07:02.314362 --- ParallelTerminationStrategy: PID 11609 died... 11:07:02.336536 run osmo-stp_10.42.42.4(pid=11609): Terminated: ok {rc=0} 11:07:02.382772 --- ParallelTerminationStrategy: PID 11612 died... 11:07:02.402772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11612): Terminated: ok {rc=0} 11:07:02.448535 --- ParallelTerminationStrategy: PID 11615 died... 11:07:02.468613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11615): Terminated: ok {rc=0} ---------------------------------------------- trial-2403 smpp esme_connect_policy_closed.py ---------------------------------------------- 11:07:02.519437 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:02.531504 tst smpp: Using 1 x bts (candidates: 1) 11:07:02.567189 tst esme_connect_policy_closed.py: using LAC 40500 11:07:02.697536 tst esme_connect_policy_closed.py: using RAC 210 11:07:02.826596 tst esme_connect_policy_closed.py: using CellId 40500 11:07:02.959749 tst esme_connect_policy_closed.py: using BVCI 40501 11:07:03.074515 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:03.085524 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:03.096158 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:03.114406 tst esme_connect_policy_closed.py: using MSISDN 8654 11:07:03.236449 tst esme_connect_policy_closed.py: using MSISDN 8655 11:07:03.348267 run osmo-stp_10.42.42.4: Starting osmo-stp 11:07:03.874081 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11619): Launched 11:07:04.183116 run osmo-stp_10.42.42.4(pid=11620): Launched 11:07:04.303259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:04.780685 run create_hlr_db(pid=11621): Launched 11:07:05.953166 run create_hlr_db(pid=11621): Terminated: ok {rc=0} 11:07:06.279335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11623): Launched 11:07:06.588309 run osmo-hlr_10.42.42.2(pid=11624): Launched 11:07:06.706710 run osmo-msc_10.42.42.5: Starting osmo-msc 11:07:07.281636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11626): Launched 11:07:07.591250 run osmo-msc_10.42.42.5(pid=11627): Launched 11:07:07.763447 run osmo-hlr_10.42.42.2(pid=11624): ERR: Terminated: ERROR {rc=237} [trial-2403↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11624)] 11:07:07.896363 run osmo-hlr_10.42.42.2(pid=11624): stdout: | (launched: 2022-12-14_11:07:06.531443) 11:07:08.037338 run osmo-hlr_10.42.42.2(pid=11624): stderr: | 20221214110706715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110706715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110706715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110706716 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110706716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110706716 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110706727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110706736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110706736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110706736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:08.175510 run osmo-hlr_10.42.42.2(pid=11624): stdout: | (launched: 2022-12-14_11:07:06.531443) 11:07:08.305851 run osmo-hlr_10.42.42.2(pid=11624): stderr: | 20221214110706715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110706715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110706715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110706716 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110706716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110706716 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110706727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110706736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110706736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110706736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:08.463191 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=11624): Process ended prematurely: osmo-hlr_10.42.42.2(pid=11624) [trial-2403↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11624)] [trial-2403↪smpp↪esme_connect_policy_closed.py:31] 11:07:08.472348 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 11:07:08.500588 run osmo-msc_10.42.42.5(pid=11627): ERR: Terminated: ERROR {rc=9} [trial-2403↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=11627)] 11:07:08.552206 run osmo-msc_10.42.42.5(pid=11627): stdout: | (launched: 2022-12-14_11:07:07.534322) 11:07:08.605639 run osmo-msc_10.42.42.5(pid=11627): stderr: | 20221214110707849 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221214110707849 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221214110707849 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110707849 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221214110707849 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221214110707849 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221214110707850 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221214110707850 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214110707850 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 11:07:08.658613 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11619): Terminating (SIGTERM) 11:07:08.701720 run osmo-stp_10.42.42.4(pid=11620): Terminating (SIGTERM) 11:07:08.745223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11623): Terminating (SIGTERM) 11:07:08.789441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11626): Terminating (SIGTERM) 11:07:08.835238 --- ParallelTerminationStrategy: PID 11619 died... 11:07:08.856264 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11619): Terminated: ok {rc=0} 11:07:08.904810 --- ParallelTerminationStrategy: PID 11620 died... 11:07:08.925486 run osmo-stp_10.42.42.4(pid=11620): Terminated: ok {rc=0} 11:07:08.972533 --- ParallelTerminationStrategy: PID 11623 died... 11:07:08.992499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11623): Terminated: ok {rc=0} 11:07:09.039738 --- ParallelTerminationStrategy: PID 11626 died... 11:07:09.059820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11626): Terminated: ok {rc=0} ---------------------------------------------- trial-2403 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 11:07:09.112278 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:09.123827 tst smpp: Using 1 x bts (candidates: 1) 11:07:09.160574 tst esme_ms_sms_storeforward.py: using LAC 40501 11:07:09.283644 tst esme_ms_sms_storeforward.py: using RAC 211 11:07:09.406108 tst esme_ms_sms_storeforward.py: using CellId 40501 11:07:09.528646 tst esme_ms_sms_storeforward.py: using BVCI 40502 11:07:09.641999 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:09.652432 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:09.663016 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:09.673256 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:09.683421 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:09.693970 tst smpp: Using 1 x modem (candidates: 1) 11:07:09.822867 tst esme_ms_sms_storeforward.py: using MSISDN 8656 11:07:09.935360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:10.410820 run create_hlr_db(pid=11630): Launched 11:07:11.586289 run create_hlr_db(pid=11630): Terminated: ok {rc=0} 11:07:11.912056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11632): Launched 11:07:12.221140 run osmo-hlr_10.42.42.2(pid=11633): Launched 11:07:12.339917 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:12.888486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11635): Launched 11:07:13.198608 run osmo-stp_10.42.42.5(pid=11636): Launched 11:07:13.317768 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:13.877767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11638): Launched 11:07:14.187031 run osmo-msc_10.42.42.6(pid=11639): Launched 11:07:14.362347 run osmo-stp_10.42.42.5(pid=11636): ERR: Terminated: ERROR {rc=1} [trial-2403↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11636)] 11:07:14.493387 run osmo-stp_10.42.42.5(pid=11636): stdout: | (launched: 2022-12-14_11:07:13.141408) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:14.624171 run osmo-stp_10.42.42.5(pid=11636): stderr: | 20221214110713312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110713313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110713313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110713313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110713314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110713314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110713314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:14.753390 run osmo-stp_10.42.42.5(pid=11636): stdout: | (launched: 2022-12-14_11:07:13.141408) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:14.876461 run osmo-stp_10.42.42.5(pid=11636): stderr: | 20221214110713312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110713313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110713313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110713313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110713314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110713314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110713314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:15.024080 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=11636): Process ended prematurely: osmo-stp_10.42.42.5(pid=11636) [trial-2403↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11636)] [trial-2403↪smpp↪esme_ms_sms_storeforward.py:30] 11:07:15.032684 tst esme_ms_sms_storeforward.py:30: Test FAILED (5.9 sec) 11:07:15.059191 run osmo-hlr_10.42.42.2(pid=11633): ERR: Terminated: ERROR {rc=237} [trial-2403↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11633)] 11:07:15.108196 run osmo-hlr_10.42.42.2(pid=11633): stdout: | (launched: 2022-12-14_11:07:12.163570) 11:07:15.158576 run osmo-hlr_10.42.42.2(pid=11633): stderr: | 20221214110712340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110712340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110712340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110712340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110712340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110712340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110712353 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110712363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110712364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110712364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:15.228808 run osmo-msc_10.42.42.6(pid=11639): ERR: Terminated: ERROR {rc=2} [trial-2403↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11639)] 11:07:15.276863 run osmo-msc_10.42.42.6(pid=11639): stdout: | (launched: 2022-12-14_11:07:14.129837) 11:07:15.327185 run osmo-msc_10.42.42.6(pid=11639): stderr: | 20221214110714398 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110714398 DLGLOBAL DEBUG validating counter group 0x7fee8bbdcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110714398 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110714399 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110714399 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110714399 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110714401 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110714401 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110714402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110714402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:15.377796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11632): Terminating (SIGTERM) 11:07:15.418930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11635): Terminating (SIGTERM) 11:07:15.459622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11638): Terminating (SIGTERM) 11:07:15.500483 --- ParallelTerminationStrategy: PID 11632 died... 11:07:15.520529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11632): Terminated: ok {rc=0} 11:07:15.565473 --- ParallelTerminationStrategy: PID 11635 died... 11:07:15.584751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11635): Terminated: ok {rc=0} 11:07:15.629420 --- ParallelTerminationStrategy: PID 11638 died... 11:07:15.648711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11638): Terminated: ok {rc=0} 11:07:15.736276 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 smpp esme_ms_sms_transaction.py ---------------------------------------------- 11:07:16.826781 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:16.839204 tst smpp: Using 1 x bts (candidates: 1) 11:07:16.878223 tst esme_ms_sms_transaction.py: using LAC 40502 11:07:17.034999 tst esme_ms_sms_transaction.py: using RAC 212 11:07:17.155791 tst esme_ms_sms_transaction.py: using CellId 40502 11:07:17.310309 tst esme_ms_sms_transaction.py: using BVCI 40503 11:07:17.431485 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:17.442875 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:17.453969 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:17.464933 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:17.476587 tst smpp: Using 1 x ip_address (candidates: 6) 11:07:17.488191 tst smpp: Using 1 x modem (candidates: 1) 11:07:17.621119 tst esme_ms_sms_transaction.py: using MSISDN 8657 11:07:17.739737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:18.249789 run create_hlr_db(pid=11641): Launched 11:07:18.383252 bus /sierra_2: Setting Powered False 11:07:19.448430 run create_hlr_db(pid=11641): Terminated: ok {rc=0} 11:07:19.892437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11643): Launched 11:07:20.202220 run osmo-hlr_10.42.42.2(pid=11644): Launched 11:07:20.319907 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:20.861470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11646): Launched 11:07:21.170585 run osmo-stp_10.42.42.5(pid=11647): Launched 11:07:21.290390 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:21.845980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11649): Launched 11:07:22.155848 run osmo-msc_10.42.42.6(pid=11650): Launched 11:07:22.328465 run osmo-stp_10.42.42.5(pid=11647): ERR: Terminated: ERROR {rc=1} [trial-2403↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11647)] 11:07:22.458513 run osmo-stp_10.42.42.5(pid=11647): stdout: | (launched: 2022-12-14_11:07:21.113082) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:22.588288 run osmo-stp_10.42.42.5(pid=11647): stderr: | 20221214110721282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110721282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110721283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110721283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110721284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110721284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110721284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:22.716678 run osmo-stp_10.42.42.5(pid=11647): stdout: | (launched: 2022-12-14_11:07:21.113082) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:22.839378 run osmo-stp_10.42.42.5(pid=11647): stderr: | 20221214110721282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110721282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110721283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110721283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110721284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110721284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110721284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:22.985979 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=11647): Process ended prematurely: osmo-stp_10.42.42.5(pid=11647) [trial-2403↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11647)] [trial-2403↪smpp↪esme_ms_sms_transaction.py:28] 11:07:22.994496 tst esme_ms_sms_transaction.py:28: Test FAILED (6.2 sec) 11:07:23.020686 run osmo-hlr_10.42.42.2(pid=11644): ERR: Terminated: ERROR {rc=237} [trial-2403↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11644)] 11:07:23.070357 run osmo-hlr_10.42.42.2(pid=11644): stdout: | (launched: 2022-12-14_11:07:20.145341) 11:07:23.121286 run osmo-hlr_10.42.42.2(pid=11644): stderr: | 20221214110720319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110720319 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110720319 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110720319 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110720319 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110720319 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110720334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110720342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110720343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110720343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:23.191725 run osmo-msc_10.42.42.6(pid=11650): ERR: Terminated: ERROR {rc=2} [trial-2403↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11650)] 11:07:23.239710 run osmo-msc_10.42.42.6(pid=11650): stdout: | (launched: 2022-12-14_11:07:22.098760) 11:07:23.289979 run osmo-msc_10.42.42.6(pid=11650): stderr: | 20221214110722370 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110722370 DLGLOBAL DEBUG validating counter group 0x7f4649d9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110722370 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110722370 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110722370 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110722370 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110722372 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110722373 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110722373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110722373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:23.340426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11643): Terminating (SIGTERM) 11:07:23.381066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11646): Terminating (SIGTERM) 11:07:23.421406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11649): Terminating (SIGTERM) 11:07:23.461944 --- ParallelTerminationStrategy: PID 11643 died... 11:07:23.482116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11643): Terminated: ok {rc=0} 11:07:23.527356 --- ParallelTerminationStrategy: PID 11646 died... 11:07:23.546849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11646): Terminated: ok {rc=0} 11:07:23.591688 --- ParallelTerminationStrategy: PID 11649 died... 11:07:23.611043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11649): Terminated: ok {rc=0} 11:07:23.699521 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 encryption --------------------------------------------------------------------- 11:07:24.916418 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:07:24.919813 tst encryption: Verifying 1 x bts (candidates: 11) 11:07:24.940857 tst encryption: Verifying 6 x ip_address (candidates: 9) 11:07:24.968804 tst encryption: Verifying 1 x modem (candidates: 12) 11:07:25.004489 tst encryption: Reserving 1 x bts (candidates: 11) 11:07:25.025821 tst encryption: Reserving 6 x ip_address (candidates: 9) 11:07:25.052548 tst encryption: Reserving 1 x modem (candidates: 12) 11:07:25.581520 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2403 encryption register_a5_0_authopt.py ---------------------------------------------- 11:07:25.635196 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:25.645918 tst encryption: Using 1 x bts (candidates: 1) 11:07:25.686533 tst register_a5_0_authopt.py: using LAC 40503 11:07:25.824489 tst register_a5_0_authopt.py: using RAC 213 11:07:25.947710 tst register_a5_0_authopt.py: using CellId 40503 11:07:26.071256 tst register_a5_0_authopt.py: using BVCI 40504 11:07:26.186160 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:26.196620 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:26.207095 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:26.217440 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:26.227853 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:26.239058 tst encryption: Using 1 x modem (candidates: 1) 11:07:26.362579 tst register_a5_0_authopt.py:8: start network... 11:07:26.572669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:27.054476 run create_hlr_db(pid=11655): Launched 11:07:27.175012 bus /sierra_2: Setting Powered False 11:07:28.237615 run create_hlr_db(pid=11655): Terminated: ok {rc=0} 11:07:28.694499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11657): Launched 11:07:29.029314 run osmo-hlr_10.42.42.2(pid=11658): Launched 11:07:29.157934 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:29.735943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11660): Launched 11:07:30.071021 run osmo-stp_10.42.42.5(pid=11661): Launched 11:07:30.198418 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:30.798786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11663): Launched 11:07:31.147304 run osmo-msc_10.42.42.6(pid=11664): Launched 11:07:31.521713 run osmo-stp_10.42.42.5(pid=11661): ERR: Terminated: ERROR {rc=1} [trial-2403↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11661)] 11:07:31.734954 run osmo-stp_10.42.42.5(pid=11661): stdout: | (launched: 2022-12-14_11:07:30.009951) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:31.889355 run osmo-stp_10.42.42.5(pid=11661): stderr: | 20221214110730203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110730204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110730204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110730204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110730205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110730205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110730205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:32.034280 run osmo-stp_10.42.42.5(pid=11661): stdout: | (launched: 2022-12-14_11:07:30.009951) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:32.162432 run osmo-stp_10.42.42.5(pid=11661): stderr: | 20221214110730203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110730204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110730204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110730204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110730205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110730205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110730205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:32.316622 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11661): Process ended prematurely: osmo-stp_10.42.42.5(pid=11661) [trial-2403↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11661)] [trial-2403↪encryption↪register_a5_0_authopt.py:8] 11:07:32.327014 tst register_a5_0_authopt.py:8: Test FAILED (6.7 sec) 11:07:32.355276 run osmo-hlr_10.42.42.2(pid=11658): ERR: Terminated: ERROR {rc=237} [trial-2403↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11658)] 11:07:32.409142 run osmo-hlr_10.42.42.2(pid=11658): stdout: | (launched: 2022-12-14_11:07:28.967719) 11:07:32.459315 run osmo-hlr_10.42.42.2(pid=11658): stderr: | 20221214110729166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110729167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110729167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110729167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110729167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110729167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110729179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110729190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110729190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110729190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:32.529868 run osmo-msc_10.42.42.6(pid=11664): ERR: Terminated: ERROR {rc=2} [trial-2403↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11664)] 11:07:32.578282 run osmo-msc_10.42.42.6(pid=11664): stdout: | (launched: 2022-12-14_11:07:31.083442) 11:07:32.628551 run osmo-msc_10.42.42.6(pid=11664): stderr: | 20221214110731628 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110731628 DLGLOBAL DEBUG validating counter group 0x7fee78ae0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110731628 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110731628 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110731628 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110731629 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110731630 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110731631 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110731631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110731631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:32.679435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11657): Terminating (SIGTERM) 11:07:32.720359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11660): Terminating (SIGTERM) 11:07:32.761219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11663): Terminating (SIGTERM) 11:07:32.802153 --- ParallelTerminationStrategy: PID 11657 died... 11:07:32.822113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11657): Terminated: ok {rc=0} 11:07:32.867454 --- ParallelTerminationStrategy: PID 11660 died... 11:07:32.886659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11660): Terminated: ok {rc=0} 11:07:32.931331 --- ParallelTerminationStrategy: PID 11663 died... 11:07:32.950658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11663): Terminated: ok {rc=0} 11:07:33.039009 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 encryption register_a5_0_authreq.py ---------------------------------------------- 11:07:34.192367 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:34.203592 tst encryption: Using 1 x bts (candidates: 1) 11:07:34.237453 tst register_a5_0_authreq.py: using LAC 40504 11:07:34.367103 tst register_a5_0_authreq.py: using RAC 214 11:07:34.488766 tst register_a5_0_authreq.py: using CellId 40504 11:07:34.608595 tst register_a5_0_authreq.py: using BVCI 40505 11:07:34.720885 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:34.731635 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:34.742393 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:34.752668 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:34.763018 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:34.774499 tst encryption: Using 1 x modem (candidates: 1) 11:07:34.894027 tst register_a5_0_authreq.py:8: start network... 11:07:35.102963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:35.583848 run create_hlr_db(pid=11666): Launched 11:07:35.703569 bus /sierra_2: Setting Powered False 11:07:36.764690 run create_hlr_db(pid=11666): Terminated: ok {rc=0} 11:07:37.199265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11668): Launched 11:07:37.512550 run osmo-hlr_10.42.42.2(pid=11669): Launched 11:07:37.632274 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:38.181306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11671): Launched 11:07:38.493411 run osmo-stp_10.42.42.5(pid=11672): Launched 11:07:38.613416 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:39.177455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11674): Launched 11:07:39.490763 run osmo-msc_10.42.42.6(pid=11675): Launched 11:07:39.666337 run osmo-stp_10.42.42.5(pid=11672): ERR: Terminated: ERROR {rc=1} [trial-2403↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11672)] 11:07:39.798312 run osmo-stp_10.42.42.5(pid=11672): stdout: | (launched: 2022-12-14_11:07:38.435948) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:39.929463 run osmo-stp_10.42.42.5(pid=11672): stderr: | 20221214110738606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110738607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110738607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110738607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110738608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110738608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110738608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:40.059098 run osmo-stp_10.42.42.5(pid=11672): stdout: | (launched: 2022-12-14_11:07:38.435948) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:40.182391 run osmo-stp_10.42.42.5(pid=11672): stderr: | 20221214110738606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110738607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110738607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110738607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110738608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110738608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110738608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:40.331841 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11672): Process ended prematurely: osmo-stp_10.42.42.5(pid=11672) [trial-2403↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11672)] [trial-2403↪encryption↪register_a5_0_authreq.py:8] 11:07:40.340876 tst register_a5_0_authreq.py:8: Test FAILED (6.2 sec) 11:07:40.367486 run osmo-hlr_10.42.42.2(pid=11669): ERR: Terminated: ERROR {rc=237} [trial-2403↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11669)] 11:07:40.415915 run osmo-hlr_10.42.42.2(pid=11669): stdout: | (launched: 2022-12-14_11:07:37.455022) 11:07:40.466087 run osmo-hlr_10.42.42.2(pid=11669): stderr: | 20221214110737633 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110737633 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110737633 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110737633 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110737633 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110737633 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110737645 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110737653 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110737653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110737654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:40.535949 run osmo-msc_10.42.42.6(pid=11675): ERR: Terminated: ERROR {rc=2} [trial-2403↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11675)] 11:07:40.583730 run osmo-msc_10.42.42.6(pid=11675): stdout: | (launched: 2022-12-14_11:07:39.432867) 11:07:40.633494 run osmo-msc_10.42.42.6(pid=11675): stderr: | 20221214110739706 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110739706 DLGLOBAL DEBUG validating counter group 0x7fdd59302c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110739706 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110739706 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110739706 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110739706 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110739708 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110739708 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110739709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110739709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:40.683862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11668): Terminating (SIGTERM) 11:07:40.724253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11671): Terminating (SIGTERM) 11:07:40.764727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11674): Terminating (SIGTERM) 11:07:40.805362 --- ParallelTerminationStrategy: PID 11668 died... 11:07:40.825144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11668): Terminated: ok {rc=0} 11:07:40.869847 --- ParallelTerminationStrategy: PID 11671 died... 11:07:40.888868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11671): Terminated: ok {rc=0} 11:07:40.933407 --- ParallelTerminationStrategy: PID 11674 died... 11:07:40.952531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11674): Terminated: ok {rc=0} 11:07:41.040434 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 encryption register_a5_1_authreq.py ---------------------------------------------- 11:07:42.196154 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:42.208123 tst encryption: Using 1 x bts (candidates: 1) 11:07:42.249760 tst register_a5_1_authreq.py: using LAC 40505 11:07:42.379348 tst register_a5_1_authreq.py: using RAC 215 11:07:42.507797 tst register_a5_1_authreq.py: using CellId 40505 11:07:42.630490 tst register_a5_1_authreq.py: using BVCI 40506 11:07:42.745154 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:42.755654 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:42.766295 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:42.776517 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:42.786970 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:42.798962 tst encryption: Using 1 x modem (candidates: 1) 11:07:42.920928 tst register_a5_1_authreq.py:8: start network... 11:07:43.146599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:43.663000 run create_hlr_db(pid=11677): Launched 11:07:43.799913 bus /sierra_2: Setting Powered False 11:07:44.862627 run create_hlr_db(pid=11677): Terminated: ok {rc=0} 11:07:45.308583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11679): Launched 11:07:45.620621 run osmo-hlr_10.42.42.2(pid=11680): Launched 11:07:45.740752 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:46.403397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11682): Launched 11:07:46.773151 run osmo-stp_10.42.42.5(pid=11683): Launched 11:07:46.968238 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:47.690869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11685): Launched 11:07:48.005484 run osmo-msc_10.42.42.6(pid=11686): Launched 11:07:48.179969 run osmo-stp_10.42.42.5(pid=11683): ERR: Terminated: ERROR {rc=1} [trial-2403↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11683)] 11:07:48.311998 run osmo-stp_10.42.42.5(pid=11683): stdout: | (launched: 2022-12-14_11:07:46.711634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:48.444695 run osmo-stp_10.42.42.5(pid=11683): stderr: | 20221214110747037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110747037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110747039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110747040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110747042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110747042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110747042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:48.574634 run osmo-stp_10.42.42.5(pid=11683): stdout: | (launched: 2022-12-14_11:07:46.711634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:48.698246 run osmo-stp_10.42.42.5(pid=11683): stderr: | 20221214110747037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110747037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110747039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110747040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110747042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110747042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110747042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:48.847147 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11683): Process ended prematurely: osmo-stp_10.42.42.5(pid=11683) [trial-2403↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11683)] [trial-2403↪encryption↪register_a5_1_authreq.py:8] 11:07:48.856338 tst register_a5_1_authreq.py:8: Test FAILED (6.7 sec) 11:07:48.883135 run osmo-hlr_10.42.42.2(pid=11680): ERR: Terminated: ERROR {rc=237} [trial-2403↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11680)] 11:07:48.931590 run osmo-hlr_10.42.42.2(pid=11680): stdout: | (launched: 2022-12-14_11:07:45.562872) 11:07:48.981708 run osmo-hlr_10.42.42.2(pid=11680): stderr: | 20221214110745738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110745738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110745738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110745739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110745739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110745739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110745751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110745761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110745761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110745762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:49.051887 run osmo-msc_10.42.42.6(pid=11686): ERR: Terminated: ERROR {rc=2} [trial-2403↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11686)] 11:07:49.099494 run osmo-msc_10.42.42.6(pid=11686): stdout: | (launched: 2022-12-14_11:07:47.947175) 11:07:49.149477 run osmo-msc_10.42.42.6(pid=11686): stderr: | 20221214110748218 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110748218 DLGLOBAL DEBUG validating counter group 0x7fd188b57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110748219 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110748219 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110748219 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110748219 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110748221 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110748221 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110748221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110748221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:49.199812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11679): Terminating (SIGTERM) 11:07:49.240325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11682): Terminating (SIGTERM) 11:07:49.280987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11685): Terminating (SIGTERM) 11:07:49.321887 --- ParallelTerminationStrategy: PID 11679 died... 11:07:49.341967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11679): Terminated: ok {rc=0} 11:07:49.387133 --- ParallelTerminationStrategy: PID 11682 died... 11:07:49.406468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11682): Terminated: ok {rc=0} 11:07:49.451177 --- ParallelTerminationStrategy: PID 11685 died... 11:07:49.470576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11685): Terminated: ok {rc=0} 11:07:49.556147 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2403 encryption register_a5_3_authreq.py ---------------------------------------------- 11:07:50.710140 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:50.722009 tst encryption: Using 1 x bts (candidates: 1) 11:07:50.758491 tst register_a5_3_authreq.py: using LAC 40506 11:07:50.882402 tst register_a5_3_authreq.py: using RAC 216 11:07:51.005783 tst register_a5_3_authreq.py: using CellId 40506 11:07:51.127231 tst register_a5_3_authreq.py: using BVCI 40507 11:07:51.242656 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:51.253407 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:51.263950 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:51.274347 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:51.284654 tst encryption: Using 1 x ip_address (candidates: 6) 11:07:51.295240 tst encryption: Using 1 x modem (candidates: 1) 11:07:51.423787 tst register_a5_3_authreq.py:8: start network... 11:07:51.633440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:52.115886 run create_hlr_db(pid=11688): Launched 11:07:52.234738 bus /sierra_2: Setting Powered False 11:07:53.296847 run create_hlr_db(pid=11688): Terminated: ok {rc=0} 11:07:53.731683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11690): Launched 11:07:54.043795 run osmo-hlr_10.42.42.2(pid=11691): Launched 11:07:54.163068 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:54.710672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11693): Launched 11:07:55.023919 run osmo-stp_10.42.42.5(pid=11694): Launched 11:07:55.144188 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:55.708639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11696): Launched 11:07:56.022664 run osmo-msc_10.42.42.6(pid=11697): Launched 11:07:56.198143 run osmo-stp_10.42.42.5(pid=11694): ERR: Terminated: ERROR {rc=1} [trial-2403↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11694)] 11:07:56.331128 run osmo-stp_10.42.42.5(pid=11694): stdout: | (launched: 2022-12-14_11:07:54.966380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:56.463062 run osmo-stp_10.42.42.5(pid=11694): stderr: | 20221214110755137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110755137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110755137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110755138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110755138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110755138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110755138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:56.593657 run osmo-stp_10.42.42.5(pid=11694): stdout: | (launched: 2022-12-14_11:07:54.966380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:56.718248 run osmo-stp_10.42.42.5(pid=11694): stderr: | 20221214110755137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214110755137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214110755137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214110755138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214110755138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214110755138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214110755138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:56.867296 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11694): Process ended prematurely: osmo-stp_10.42.42.5(pid=11694) [trial-2403↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11694)] [trial-2403↪encryption↪register_a5_3_authreq.py:8] 11:07:56.876631 tst register_a5_3_authreq.py:8: Test FAILED (6.2 sec) 11:07:56.903199 run osmo-hlr_10.42.42.2(pid=11691): ERR: Terminated: ERROR {rc=237} [trial-2403↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11691)] 11:07:56.951936 run osmo-hlr_10.42.42.2(pid=11691): stdout: | (launched: 2022-12-14_11:07:53.986410) 11:07:57.002475 run osmo-hlr_10.42.42.2(pid=11691): stderr: | 20221214110754161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214110754161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214110754161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214110754161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214110754161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214110754161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214110754174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214110754182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214110754182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214110754182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:57.072498 run osmo-msc_10.42.42.6(pid=11697): ERR: Terminated: ERROR {rc=2} [trial-2403↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11697)] 11:07:57.120538 run osmo-msc_10.42.42.6(pid=11697): stdout: | (launched: 2022-12-14_11:07:55.965197) 11:07:57.170664 run osmo-msc_10.42.42.6(pid=11697): stderr: | 20221214110756234 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214110756234 DLGLOBAL DEBUG validating counter group 0x7f76f39acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214110756235 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214110756235 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214110756235 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214110756235 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214110756237 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214110756237 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214110756237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214110756237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:57.221328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11690): Terminating (SIGTERM) 11:07:57.262086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11693): Terminating (SIGTERM) 11:07:57.302737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11696): Terminating (SIGTERM) 11:07:57.343611 --- ParallelTerminationStrategy: PID 11690 died... 11:07:57.363279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11690): Terminated: ok {rc=0} 11:07:57.407913 --- ParallelTerminationStrategy: PID 11693 died... 11:07:57.427109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11693): Terminated: ok {rc=0} 11:07:57.471419 --- ParallelTerminationStrategy: PID 11696 died... 11:07:57.490692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11696): Terminated: ok {rc=0} 11:07:57.578844 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 11:07:58.786888 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:07:58.792146 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 11:07:58.810761 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 11:07:58.838624 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 11:07:58.865937 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 11:07:58.885121 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 11:07:58.911722 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 11:07:59.421556 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2403 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 11:07:59.426468 tst handover.py:11: TEST_CONFIG: {} 11:07:59.635630 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:07:59.651434 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:07:59.674165 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:07:59.725470 tst handover.py: using MSISDN 8658 11:07:59.842147 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8658', subscriber_id=0} 11:07:59.951177 run srsepc_10.42.42.118: Starting srsepc 11:08:01.840889 run rm-remote-dir(pid=11702): Launched 11:08:02.047809 bus /sierra_2: Setting Powered False 11:08:03.117641 run rm-remote-dir(pid=11702): Terminated: ok {rc=0} 11:08:03.624301 run mk-remote-dir(pid=11703): Launched 11:08:04.809237 run mk-remote-dir(pid=11703): Terminated: ok {rc=0} 11:08:05.102379 run scp-inst-to-remote(pid=11704): Launched 11:08:07.297746 run scp-inst-to-remote(pid=11704): Terminated: ok {rc=0} 11:08:07.660925 run rm-remote-dir(pid=11706): Launched 11:08:08.859946 run rm-remote-dir(pid=11706): Terminated: ok {rc=0} 11:08:09.225615 run mk-remote-dir(pid=11707): Launched 11:08:10.421197 run mk-remote-dir(pid=11707): Terminated: ok {rc=0} 11:08:10.732877 run scp-cfg-to-remote(pid=11708): Launched 11:08:11.925820 run scp-cfg-to-remote(pid=11708): Terminated: ok {rc=0} 11:08:12.235099 run scp-db-to-remote(pid=11710): Launched 11:08:13.428183 run scp-db-to-remote(pid=11710): Terminated: ok {rc=0} 11:08:13.570695 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:08:13.907955 run patchelf(pid=11712): Launched 11:08:15.100266 run patchelf(pid=11712): Terminated: ok {rc=0} 11:08:15.242369 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:08:15.578241 run setcap-netadm(pid=11713): Launched 11:08:16.786396 run setcap-netadm(pid=11713): Terminated: ok {rc=0} 11:08:17.141719 run srsepc(pid=11714): Launched 11:08:17.310273 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:08:18.444395 run rm-remote-dir(pid=11715): Launched 11:08:18.622964 run srsepc(pid=11714): ERR: Terminated: ERROR {rc=127} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11714)] 11:08:18.758939 run srsepc(pid=11714): stdout: | (launched: 2022-12-14_11:08:17.080281) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:08:18.895551 run srsepc(pid=11714): stderr: | (launched: 2022-12-14_11:08:17.127727) | Connection to 10.42.42.116 closed. 11:08:19.032248 run srsepc(pid=11714): stdout: | (launched: 2022-12-14_11:08:17.080281) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:08:19.164183 run srsepc(pid=11714): stderr: | (launched: 2022-12-14_11:08:17.127727) | Connection to 10.42.42.116 closed. 11:08:19.319771 run rm-remote-dir(pid=11715): Terminating (SIGINT) 11:08:19.501396 run rm-remote-dir(pid=11715): Terminated: ok {rc=0} 11:08:19.631955 tst handover.py:37: ERR: Error: srsepc(pid=11714): Process ended prematurely: srsepc(pid=11714) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11714)] [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 11:08:19.642098 tst handover.py:37: Test FAILED (20.2 sec) 11:08:19.721034 run scp-back-log(pid=11716): Launched 11:08:20.798634 run scp-back-log(pid=11716): ERR: Terminated: ERROR {rc=1} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11716)] 11:08:20.860285 run scp-back-log(pid=11716): stdout: | (launched: 2022-12-14_11:08:19.689715) 11:08:20.923435 run scp-back-log(pid=11716): stderr: | (launched: 2022-12-14_11:08:19.709705) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:08:20.994695 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11716): launch_sync(): local process exited with status 1 [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11716)]') ---------------------------------------------- trial-2403 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 11:08:21.040218 tst iperf3_bidir.py:13: Number of physical ue: 1 11:08:21.249309 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:08:21.292043 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 11:08:21.500355 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:08:21.516174 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:08:21.548757 tst iperf3_bidir.py: using MSISDN 8659 11:08:21.662803 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8659', subscriber_id=0} 11:08:21.771400 run srsepc_10.42.42.118: Starting srsepc 11:08:22.451699 run rm-remote-dir(pid=11718): Launched 11:08:23.647895 run rm-remote-dir(pid=11718): Terminated: ok {rc=0} 11:08:24.013428 run mk-remote-dir(pid=11719): Launched 11:08:25.208917 run mk-remote-dir(pid=11719): Terminated: ok {rc=0} 11:08:25.519731 run scp-inst-to-remote(pid=11720): Launched 11:08:27.715463 run scp-inst-to-remote(pid=11720): Terminated: ok {rc=0} 11:08:28.078165 run rm-remote-dir(pid=11722): Launched 11:08:29.273351 run rm-remote-dir(pid=11722): Terminated: ok {rc=0} 11:08:29.636678 run mk-remote-dir(pid=11723): Launched 11:08:30.841583 run mk-remote-dir(pid=11723): Terminated: ok {rc=0} 11:08:31.211020 run scp-cfg-to-remote(pid=11724): Launched 11:08:32.420699 run scp-cfg-to-remote(pid=11724): Terminated: ok {rc=0} 11:08:32.711295 run scp-db-to-remote(pid=11726): Launched 11:08:33.890538 run scp-db-to-remote(pid=11726): Terminated: ok {rc=0} 11:08:34.023996 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:08:34.337925 run patchelf(pid=11728): Launched 11:08:35.517700 run patchelf(pid=11728): Terminated: ok {rc=0} 11:08:35.651025 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:08:35.963904 run setcap-netadm(pid=11729): Launched 11:08:37.144157 run setcap-netadm(pid=11729): Terminated: ok {rc=0} 11:08:37.471663 run srsepc(pid=11730): Launched 11:08:37.588171 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:08:38.708752 run rm-remote-dir(pid=11731): Launched 11:08:38.887403 run srsepc(pid=11730): ERR: Terminated: ERROR {rc=127} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11730)] 11:08:39.023713 run srsepc(pid=11730): stdout: | (launched: 2022-12-14_11:08:37.414279) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:08:39.160784 run srsepc(pid=11730): stderr: | (launched: 2022-12-14_11:08:37.460380) | Connection to 10.42.42.116 closed. 11:08:39.297646 run srsepc(pid=11730): stdout: | (launched: 2022-12-14_11:08:37.414279) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:08:39.429362 run srsepc(pid=11730): stderr: | (launched: 2022-12-14_11:08:37.460380) | Connection to 10.42.42.116 closed. 11:08:39.585170 run rm-remote-dir(pid=11731): Terminating (SIGINT) 11:08:39.765366 run rm-remote-dir(pid=11731): Terminated: ok {rc=0} 11:08:39.895497 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=11730): Process ended prematurely: srsepc(pid=11730) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11730)] [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 11:08:39.905788 tst iperf3_bidir.py:42: Test FAILED (18.9 sec) 11:08:39.985025 run scp-back-log(pid=11732): Launched 11:08:41.062413 run scp-back-log(pid=11732): ERR: Terminated: ERROR {rc=1} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11732)] 11:08:41.123780 run scp-back-log(pid=11732): stdout: | (launched: 2022-12-14_11:08:39.953395) 11:08:41.186795 run scp-back-log(pid=11732): stderr: | (launched: 2022-12-14_11:08:39.973501) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:08:41.257636 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11732): launch_sync(): local process exited with status 1 [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11732)]') ---------------------------------------------- trial-2403 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 11:08:41.303037 tst iperf3_dl.py:13: Number of physical ue: 1 11:08:41.511612 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:08:41.555657 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 11:08:41.761386 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:08:41.777365 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:08:41.810394 tst iperf3_dl.py: using MSISDN 8660 11:08:41.923654 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8660', subscriber_id=0} 11:08:42.031423 run srsepc_10.42.42.118: Starting srsepc 11:08:42.663994 run rm-remote-dir(pid=11734): Launched 11:08:43.846427 run rm-remote-dir(pid=11734): Terminated: ok {rc=0} 11:08:44.186567 run mk-remote-dir(pid=11735): Launched 11:08:45.366902 run mk-remote-dir(pid=11735): Terminated: ok {rc=0} 11:08:45.655989 run scp-inst-to-remote(pid=11736): Launched 11:08:47.835613 run scp-inst-to-remote(pid=11736): Terminated: ok {rc=0} 11:08:48.173679 run rm-remote-dir(pid=11738): Launched 11:08:49.355286 run rm-remote-dir(pid=11738): Terminated: ok {rc=0} 11:08:49.693931 run mk-remote-dir(pid=11739): Launched 11:08:50.879707 run mk-remote-dir(pid=11739): Terminated: ok {rc=0} 11:08:51.188243 run scp-cfg-to-remote(pid=11740): Launched 11:08:52.381303 run scp-cfg-to-remote(pid=11740): Terminated: ok {rc=0} 11:08:52.688172 run scp-db-to-remote(pid=11742): Launched 11:08:53.882044 run scp-db-to-remote(pid=11742): Terminated: ok {rc=0} 11:08:54.023428 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:08:54.357269 run patchelf(pid=11744): Launched 11:08:55.549197 run patchelf(pid=11744): Terminated: ok {rc=0} 11:08:55.690856 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:08:56.025701 run setcap-netadm(pid=11745): Launched 11:08:57.217075 run setcap-netadm(pid=11745): Terminated: ok {rc=0} 11:08:57.566596 run srsepc(pid=11746): Launched 11:08:57.690861 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:08:58.890741 run rm-remote-dir(pid=11747): Launched 11:08:59.082198 run srsepc(pid=11746): ERR: Terminated: ERROR {rc=127} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11746)] 11:08:59.221586 run srsepc(pid=11746): stdout: | (launched: 2022-12-14_11:08:57.505443) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:08:59.359743 run srsepc(pid=11746): stderr: | (launched: 2022-12-14_11:08:57.554519) | Connection to 10.42.42.116 closed. 11:08:59.497750 run srsepc(pid=11746): stdout: | (launched: 2022-12-14_11:08:57.505443) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:08:59.630844 run srsepc(pid=11746): stderr: | (launched: 2022-12-14_11:08:57.554519) | Connection to 10.42.42.116 closed. 11:08:59.787350 run rm-remote-dir(pid=11747): Terminating (SIGINT) 11:08:59.968440 run rm-remote-dir(pid=11747): Terminated: ok {rc=0} 11:09:00.098838 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=11746): Process ended prematurely: srsepc(pid=11746) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11746)] [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 11:09:00.109153 tst iperf3_dl.py:42: Test FAILED (18.8 sec) 11:09:00.189151 run scp-back-log(pid=11748): Launched 11:09:01.265076 run scp-back-log(pid=11748): ERR: Terminated: ERROR {rc=1} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11748)] 11:09:01.339580 run scp-back-log(pid=11748): stdout: | (launched: 2022-12-14_11:09:00.156986) 11:09:01.425006 run scp-back-log(pid=11748): stderr: | (launched: 2022-12-14_11:09:00.177076) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:09:01.518137 tst srsepc_10.42.42.118: Error('scp-back-log(pid=11748): launch_sync(): local process exited with status 1 [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=11748)]') ---------------------------------------------- trial-2403 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 11:09:01.581480 tst iperf3_ul.py:13: Number of physical ue: 1 11:09:01.845519 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:09:01.904680 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 11:09:02.156019 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:09:02.173977 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:09:02.208102 tst iperf3_ul.py: using MSISDN 8661 11:09:02.330686 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8661', subscriber_id=0} 11:09:02.444868 run srsepc_10.42.42.118: Starting srsepc 11:09:03.167175 run rm-remote-dir(pid=11828): Launched 11:09:04.465233 run rm-remote-dir(pid=11828): Terminated: ok {rc=0} 11:09:04.838073 run mk-remote-dir(pid=12021): Launched 11:09:06.108491 run mk-remote-dir(pid=12021): Terminated: ok {rc=0} 11:09:06.422013 run scp-inst-to-remote(pid=12024): Launched 11:09:08.678261 run scp-inst-to-remote(pid=12024): Terminated: ok {rc=0} 11:09:09.028064 run rm-remote-dir(pid=12026): Launched 11:09:10.237075 run rm-remote-dir(pid=12026): Terminated: ok {rc=0} 11:09:10.591183 run mk-remote-dir(pid=12027): Launched 11:09:11.815006 run mk-remote-dir(pid=12027): Terminated: ok {rc=0} 11:09:12.116192 run scp-cfg-to-remote(pid=12028): Launched 11:09:13.351463 run scp-cfg-to-remote(pid=12028): Terminated: ok {rc=0} 11:09:13.653257 run scp-db-to-remote(pid=12030): Launched 11:09:14.844011 run scp-db-to-remote(pid=12030): Terminated: ok {rc=0} 11:09:14.982685 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:09:15.313344 run patchelf(pid=12032): Launched 11:09:16.596491 run patchelf(pid=12032): Terminated: ok {rc=0} 11:09:16.783510 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:09:17.183557 run setcap-netadm(pid=12033): Launched 11:09:18.492609 run setcap-netadm(pid=12033): Terminated: ok {rc=0} 11:09:18.855703 run srsepc(pid=12034): Launched 11:09:19.038379 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:09:20.343635 run rm-remote-dir(pid=12035): Launched 11:09:20.662261 run srsepc(pid=12034): ERR: Terminated: ERROR {rc=127} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=12034)] 11:09:20.817331 run srsepc(pid=12034): stdout: | (launched: 2022-12-14_11:09:18.791920) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:09:20.969314 run srsepc(pid=12034): stderr: | (launched: 2022-12-14_11:09:18.844178) | Connection to 10.42.42.116 closed. 11:09:21.120605 run srsepc(pid=12034): stdout: | (launched: 2022-12-14_11:09:18.791920) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:09:21.266312 run srsepc(pid=12034): stderr: | (launched: 2022-12-14_11:09:18.844178) | Connection to 10.42.42.116 closed. 11:09:21.438542 run rm-remote-dir(pid=12035): Terminating (SIGINT) 11:09:21.638724 run rm-remote-dir(pid=12035): Terminated: ok {rc=0} 11:09:21.781773 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=12034): Process ended prematurely: srsepc(pid=12034) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=12034)] [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 11:09:21.794077 tst iperf3_ul.py:42: Test FAILED (20.2 sec) 11:09:21.880599 run scp-back-log(pid=12036): Launched 11:09:23.004693 run scp-back-log(pid=12036): ERR: Terminated: ERROR {rc=1} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=12036)] 11:09:23.071425 run scp-back-log(pid=12036): stdout: | (launched: 2022-12-14_11:09:21.847041) 11:09:23.142486 run scp-back-log(pid=12036): stderr: | (launched: 2022-12-14_11:09:21.869220) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:09:23.220708 tst srsepc_10.42.42.118: Error('scp-back-log(pid=12036): launch_sync(): local process exited with status 1 [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=12036)]') ---------------------------------------------- trial-2403 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 11:09:23.272112 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:09:23.291022 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:09:23.317057 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:09:23.368655 tst ping.py: using MSISDN 8662 11:09:23.498039 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8662', subscriber_id=0} 11:09:23.620172 run srsepc_10.42.42.118: Starting srsepc 11:09:24.331253 run rm-remote-dir(pid=12038): Launched 11:09:25.524005 run rm-remote-dir(pid=12038): Terminated: ok {rc=0} 11:09:25.867065 run mk-remote-dir(pid=12040): Launched 11:09:27.048652 run mk-remote-dir(pid=12040): Terminated: ok {rc=0} 11:09:27.339889 run scp-inst-to-remote(pid=12041): Launched 11:09:29.522629 run scp-inst-to-remote(pid=12041): Terminated: ok {rc=0} 11:09:29.863141 run rm-remote-dir(pid=12043): Launched 11:09:31.050042 run rm-remote-dir(pid=12043): Terminated: ok {rc=0} 11:09:31.424705 run mk-remote-dir(pid=12044): Launched 11:09:32.656555 run mk-remote-dir(pid=12044): Terminated: ok {rc=0} 11:09:32.947816 run scp-cfg-to-remote(pid=12045): Launched 11:09:34.128263 run scp-cfg-to-remote(pid=12045): Terminated: ok {rc=0} 11:09:34.417524 run scp-db-to-remote(pid=12047): Launched 11:09:35.596739 run scp-db-to-remote(pid=12047): Terminated: ok {rc=0} 11:09:35.729764 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:09:36.043158 run patchelf(pid=12049): Launched 11:09:37.223153 run patchelf(pid=12049): Terminated: ok {rc=0} 11:09:37.355738 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:09:37.671043 run setcap-netadm(pid=12050): Launched 11:09:38.851480 run setcap-netadm(pid=12050): Terminated: ok {rc=0} 11:09:39.179573 run srsepc(pid=12051): Launched 11:09:39.295810 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:09:40.423191 run rm-remote-dir(pid=12052): Launched 11:09:40.618425 run srsepc(pid=12051): ERR: Terminated: ERROR {rc=127} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=12051)] 11:09:40.756405 run srsepc(pid=12051): stdout: | (launched: 2022-12-14_11:09:39.121669) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:09:40.894428 run srsepc(pid=12051): stderr: | (launched: 2022-12-14_11:09:39.167742) | Connection to 10.42.42.116 closed. 11:09:41.032175 run srsepc(pid=12051): stdout: | (launched: 2022-12-14_11:09:39.121669) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:09:41.164541 run srsepc(pid=12051): stderr: | (launched: 2022-12-14_11:09:39.167742) | Connection to 10.42.42.116 closed. 11:09:41.321569 run rm-remote-dir(pid=12052): Terminating (SIGINT) 11:09:41.503408 run rm-remote-dir(pid=12052): Terminated: ok {rc=0} 11:09:41.635019 tst ping.py:16: ERR: Error: srsepc(pid=12051): Process ended prematurely: srsepc(pid=12051) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=12051)] [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 11:09:41.645477 tst ping.py:16: Test FAILED (18.4 sec) 11:09:41.726068 run scp-back-log(pid=12053): Launched 11:09:42.803145 run scp-back-log(pid=12053): ERR: Terminated: ERROR {rc=1} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=12053)] 11:09:42.865482 run scp-back-log(pid=12053): stdout: | (launched: 2022-12-14_11:09:41.693749) 11:09:42.928914 run scp-back-log(pid=12053): stderr: | (launched: 2022-12-14_11:09:41.713818) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:09:43.000151 tst srsepc_10.42.42.118: Error('scp-back-log(pid=12053): launch_sync(): local process exited with status 1 [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=12053)]') ---------------------------------------------- trial-2403 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 11:09:43.046591 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:09:43.063780 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:09:43.087297 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:09:43.138173 tst rrc_idle_mo_ping.py: using MSISDN 8663 11:09:43.253477 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8663', subscriber_id=0} 11:09:43.362483 run srsepc_10.42.42.118: Starting srsepc 11:09:44.002402 run rm-remote-dir(pid=12055): Launched 11:09:45.187882 run rm-remote-dir(pid=12055): Terminated: ok {rc=0} 11:09:45.531016 run mk-remote-dir(pid=12056): Launched 11:09:46.713867 run mk-remote-dir(pid=12056): Terminated: ok {rc=0} 11:09:47.016549 run scp-inst-to-remote(pid=12057): Launched 11:09:49.260082 run scp-inst-to-remote(pid=12057): Terminated: ok {rc=0} 11:09:49.602241 run rm-remote-dir(pid=12059): Launched 11:09:50.783992 run rm-remote-dir(pid=12059): Terminated: ok {rc=0} 11:09:51.126747 run mk-remote-dir(pid=12060): Launched 11:09:52.309240 run mk-remote-dir(pid=12060): Terminated: ok {rc=0} 11:09:52.602815 run scp-cfg-to-remote(pid=12061): Launched 11:09:53.784738 run scp-cfg-to-remote(pid=12061): Terminated: ok {rc=0} 11:09:54.075921 run scp-db-to-remote(pid=12063): Launched 11:09:55.257264 run scp-db-to-remote(pid=12063): Terminated: ok {rc=0} 11:09:55.391575 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:09:55.706789 run patchelf(pid=12065): Launched 11:09:56.886974 run patchelf(pid=12065): Terminated: ok {rc=0} 11:09:57.021088 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:09:57.336351 run setcap-netadm(pid=12066): Launched 11:09:58.516372 run setcap-netadm(pid=12066): Terminated: ok {rc=0} 11:09:58.848051 run srsepc(pid=12067): Launched 11:09:58.963722 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:10:00.087658 run rm-remote-dir(pid=12068): Launched 11:10:00.266720 run srsepc(pid=12067): ERR: Terminated: ERROR {rc=127} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=12067)] 11:10:00.403045 run srsepc(pid=12067): stdout: | (launched: 2022-12-14_11:09:58.790036) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:10:00.540219 run srsepc(pid=12067): stderr: | (launched: 2022-12-14_11:09:58.836298) | Connection to 10.42.42.116 closed. 11:10:00.677160 run srsepc(pid=12067): stdout: | (launched: 2022-12-14_11:09:58.790036) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:10:00.809827 run srsepc(pid=12067): stderr: | (launched: 2022-12-14_11:09:58.836298) | Connection to 10.42.42.116 closed. 11:10:00.968651 run rm-remote-dir(pid=12068): Terminating (SIGINT) 11:10:01.153938 run rm-remote-dir(pid=12068): Terminated: ok {rc=0} 11:10:01.288067 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=12067): Process ended prematurely: srsepc(pid=12067) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=12067)] [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 11:10:01.299520 tst rrc_idle_mo_ping.py:16: Test FAILED (18.2 sec) 11:10:01.387148 run scp-back-log(pid=12069): Launched 11:10:02.505741 run scp-back-log(pid=12069): ERR: Terminated: ERROR {rc=1} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=12069)] 11:10:02.567339 run scp-back-log(pid=12069): stdout: | (launched: 2022-12-14_11:10:01.350678) 11:10:02.630575 run scp-back-log(pid=12069): stderr: | (launched: 2022-12-14_11:10:01.370966) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:10:02.701772 tst srsepc_10.42.42.118: Error('scp-back-log(pid=12069): launch_sync(): local process exited with status 1 [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=12069)]') ---------------------------------------------- trial-2403 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 11:10:02.748480 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:10:02.765706 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:10:02.789506 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:10:02.837993 tst rrc_idle_mt_ping.py: using MSISDN 8664 11:10:02.961612 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8664', subscriber_id=0} 11:10:03.078202 run srsepc_10.42.42.118: Starting srsepc 11:10:03.760258 run rm-remote-dir(pid=12074): Launched 11:10:04.958893 run rm-remote-dir(pid=12074): Terminated: ok {rc=0} 11:10:05.324853 run mk-remote-dir(pid=12076): Launched 11:10:06.522660 run mk-remote-dir(pid=12076): Terminated: ok {rc=0} 11:10:06.834445 run scp-inst-to-remote(pid=12077): Launched 11:10:09.029958 run scp-inst-to-remote(pid=12077): Terminated: ok {rc=0} 11:10:09.394786 run rm-remote-dir(pid=12079): Launched 11:10:10.590891 run rm-remote-dir(pid=12079): Terminated: ok {rc=0} 11:10:10.958576 run mk-remote-dir(pid=12080): Launched 11:10:12.156720 run mk-remote-dir(pid=12080): Terminated: ok {rc=0} 11:10:12.468449 run scp-cfg-to-remote(pid=12081): Launched 11:10:13.663066 run scp-cfg-to-remote(pid=12081): Terminated: ok {rc=0} 11:10:13.974727 run scp-db-to-remote(pid=12083): Launched 11:10:15.167852 run scp-db-to-remote(pid=12083): Terminated: ok {rc=0} 11:10:15.311089 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:10:15.648479 run patchelf(pid=12085): Launched 11:10:16.851031 run patchelf(pid=12085): Terminated: ok {rc=0} 11:10:16.999630 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:10:17.343244 run setcap-netadm(pid=12086): Launched 11:10:18.536476 run setcap-netadm(pid=12086): Terminated: ok {rc=0} 11:10:18.889527 run srsepc(pid=12087): Launched 11:10:19.017152 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:10:20.218642 run rm-remote-dir(pid=12088): Launched 11:10:20.412190 run srsepc(pid=12087): ERR: Terminated: ERROR {rc=127} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=12087)] 11:10:20.559132 run srsepc(pid=12087): stdout: | (launched: 2022-12-14_11:10:18.827495) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:10:20.705206 run srsepc(pid=12087): stderr: | (launched: 2022-12-14_11:10:18.877275) | Connection to 10.42.42.116 closed. 11:10:20.850757 run srsepc(pid=12087): stdout: | (launched: 2022-12-14_11:10:18.827495) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:10:20.991892 run srsepc(pid=12087): stderr: | (launched: 2022-12-14_11:10:18.877275) | Connection to 10.42.42.116 closed. 11:10:21.157961 run rm-remote-dir(pid=12088): Terminating (SIGINT) 11:10:21.350400 run rm-remote-dir(pid=12088): Terminated: ok {rc=0} 11:10:21.488803 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=12087): Process ended prematurely: srsepc(pid=12087) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=12087)] [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 11:10:21.499660 tst rrc_idle_mt_ping.py:16: Test FAILED (18.7 sec) 11:10:21.582437 run scp-back-log(pid=12089): Launched 11:10:22.663948 run scp-back-log(pid=12089): ERR: Terminated: ERROR {rc=1} [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=12089)] 11:10:22.728235 run scp-back-log(pid=12089): stdout: | (launched: 2022-12-14_11:10:21.548931) 11:10:22.794165 run scp-back-log(pid=12089): stderr: | (launched: 2022-12-14_11:10:21.569824) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:10:22.868447 tst srsepc_10.42.42.118: Error('scp-back-log(pid=12089): launch_sync(): local process exited with status 1 [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=12089)]') --------------------------------------------------------------------- trial-2403 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 11:10:23.008363 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:23.015490 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 11:10:23.057772 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 11:10:23.085115 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 11:10:23.137056 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 11:10:23.180710 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 11:10:23.207977 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 11:10:23.760040 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 11:10:23.765744 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:10:23.777010 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 11:10:23.814505 tst handover.py: using LAC 40507 11:10:23.948016 tst handover.py: using RAC 217 11:10:24.074072 tst handover.py: using CellId 40507 11:10:24.204714 tst handover.py: using BVCI 40508 11:10:24.324734 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 11:10:24.359002 tst handover.py: using LAC 40508 11:10:24.484755 tst handover.py: using RAC 218 11:10:24.610621 tst handover.py: using CellId 40508 11:10:24.735962 tst handover.py: using BVCI 40509 11:10:24.854145 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:10:24.865500 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:10:24.876609 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:10:24.887733 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:10:24.899113 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:10:24.910291 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 11:10:25.030260 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 11:10:25.150246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:25.657959 run create_hlr_db(pid=12096): Launched 11:10:26.839999 run create_hlr_db(pid=12096): Terminated: ok {rc=0} 11:10:27.186237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12098): Launched 11:10:27.512621 run osmo-hlr_10.42.42.2(pid=12099): Launched 11:10:27.638700 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:28.205582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12101): Launched 11:10:28.533646 run osmo-stp_10.42.42.5(pid=12102): Launched 11:10:28.657881 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:29.248869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12104): Launched 11:10:29.576514 run osmo-msc_10.42.42.6(pid=12105): Launched 11:10:29.759223 run osmo-stp_10.42.42.5(pid=12102): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12102)] 11:10:29.896164 run osmo-stp_10.42.42.5(pid=12102): stdout: | (launched: 2022-12-14_11:10:28.472781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:30.034493 run osmo-stp_10.42.42.5(pid=12102): stderr: | 20221214111028665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111028665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111028666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111028666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111028666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111028667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111028667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:30.170908 run osmo-stp_10.42.42.5(pid=12102): stdout: | (launched: 2022-12-14_11:10:28.472781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:30.300651 run osmo-stp_10.42.42.5(pid=12102): stderr: | 20221214111028665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111028665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111028666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111028666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111028666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111028667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111028667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:30.455530 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12102): Process ended prematurely: osmo-stp_10.42.42.5(pid=12102) [trial-2403↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12102)] [trial-2403↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 11:10:30.464550 tst handover.py:18: Test FAILED (6.7 sec) 11:10:30.492245 run osmo-hlr_10.42.42.2(pid=12099): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12099)] 11:10:30.542896 run osmo-hlr_10.42.42.2(pid=12099): stdout: | (launched: 2022-12-14_11:10:27.452226) 11:10:30.595297 run osmo-hlr_10.42.42.2(pid=12099): stderr: | 20221214111027650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111027650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111027650 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111027650 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111027650 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111027650 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111027661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111027670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111027671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111027671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:30.668381 run osmo-msc_10.42.42.6(pid=12105): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12105)] 11:10:30.718646 run osmo-msc_10.42.42.6(pid=12105): stdout: | (launched: 2022-12-14_11:10:29.515892) 11:10:30.770829 run osmo-msc_10.42.42.6(pid=12105): stderr: | 20221214111029836 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111029836 DLGLOBAL DEBUG validating counter group 0x7f51626c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111029836 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111029836 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111029836 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111029837 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111029838 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111029839 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111029839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111029839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:30.823576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12098): Terminating (SIGTERM) 11:10:30.868201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12101): Terminating (SIGTERM) 11:10:30.922221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12104): Terminating (SIGTERM) 11:10:30.970131 --- ParallelTerminationStrategy: PID 12098 died... 11:10:30.990674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12098): Terminated: ok {rc=0} 11:10:31.038083 --- ParallelTerminationStrategy: PID 12101 died... 11:10:31.059022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12101): Terminated: ok {rc=0} 11:10:31.118538 --- ParallelTerminationStrategy: PID 12104 died... 11:10:31.144069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12104): Terminated: ok {rc=0} 11:10:31.256683 bus /sierra_3: Setting Powered False 11:10:32.369196 bus /sierra_3: Setting Powered False 11:10:33.486394 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 11:10:34.728712 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:34.733904 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 11:10:34.773775 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 11:10:34.801024 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 11:10:34.852587 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 11:10:34.893319 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 11:10:34.920326 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 11:10:35.471391 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 11:10:35.476598 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:10:35.487497 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 11:10:35.525158 tst handover.py: using LAC 40509 11:10:35.644170 tst handover.py: using RAC 219 11:10:35.762800 tst handover.py: using CellId 40509 11:10:35.881737 tst handover.py: using BVCI 40510 11:10:35.992740 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 11:10:36.025510 tst handover.py: using LAC 40510 11:10:36.146710 tst handover.py: using RAC 220 11:10:36.266615 tst handover.py: using CellId 40510 11:10:36.386732 tst handover.py: using BVCI 40511 11:10:36.499097 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:10:36.510095 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:10:36.520791 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:10:36.531646 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:10:36.542772 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:10:36.553462 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 11:10:36.669118 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 11:10:36.788643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:37.270586 run create_hlr_db(pid=12110): Launched 11:10:37.397278 bus /sierra_2: Setting Powered False 11:10:38.462203 run create_hlr_db(pid=12110): Terminated: ok {rc=0} 11:10:38.877473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12112): Launched 11:10:39.186989 run osmo-hlr_10.42.42.2(pid=12113): Launched 11:10:39.304605 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:39.820709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12115): Launched 11:10:40.128190 run osmo-stp_10.42.42.5(pid=12116): Launched 11:10:40.245944 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:40.776832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12118): Launched 11:10:41.086043 run osmo-msc_10.42.42.6(pid=12119): Launched 11:10:41.258664 run osmo-stp_10.42.42.5(pid=12116): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12116)] 11:10:41.389493 run osmo-stp_10.42.42.5(pid=12116): stdout: | (launched: 2022-12-14_11:10:40.071238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:41.519737 run osmo-stp_10.42.42.5(pid=12116): stderr: | 20221214111040241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111040241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111040241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111040242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111040242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111040242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111040242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:41.647703 run osmo-stp_10.42.42.5(pid=12116): stdout: | (launched: 2022-12-14_11:10:40.071238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:41.770635 run osmo-stp_10.42.42.5(pid=12116): stderr: | 20221214111040241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111040241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111040241 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111040242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111040242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111040242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111040242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:41.917296 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12116): Process ended prematurely: osmo-stp_10.42.42.5(pid=12116) [trial-2403↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12116)] [trial-2403↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 11:10:41.925669 tst handover.py:18: Test FAILED (6.4 sec) 11:10:41.952179 run osmo-hlr_10.42.42.2(pid=12113): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12113)] 11:10:42.000732 run osmo-hlr_10.42.42.2(pid=12113): stdout: | (launched: 2022-12-14_11:10:39.129905) 11:10:42.050720 run osmo-hlr_10.42.42.2(pid=12113): stderr: | 20221214111039303 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111039303 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111039303 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111039303 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111039303 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111039304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111039316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111039324 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111039324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111039324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:42.120631 run osmo-msc_10.42.42.6(pid=12119): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12119)] 11:10:42.168459 run osmo-msc_10.42.42.6(pid=12119): stdout: | (launched: 2022-12-14_11:10:41.028207) 11:10:42.218553 run osmo-msc_10.42.42.6(pid=12119): stderr: | 20221214111041297 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111041297 DLGLOBAL DEBUG validating counter group 0x7fd68ec3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111041297 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111041297 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111041297 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111041298 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111041299 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111041300 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111041300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111041300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:42.268796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12112): Terminating (SIGTERM) 11:10:42.309165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12115): Terminating (SIGTERM) 11:10:42.349314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12118): Terminating (SIGTERM) 11:10:42.389802 --- ParallelTerminationStrategy: PID 12112 died... 11:10:42.409306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12112): Terminated: ok {rc=0} 11:10:42.453535 --- ParallelTerminationStrategy: PID 12115 died... 11:10:42.472466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12115): Terminated: ok {rc=0} 11:10:42.516533 --- ParallelTerminationStrategy: PID 12118 died... 11:10:42.535484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12118): Terminated: ok {rc=0} 11:10:42.622109 bus /sierra_3: Setting Powered False 11:10:43.725856 bus /sierra_3: Setting Powered False 11:10:44.842612 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 11:10:46.103008 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:46.109087 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 11:10:46.166630 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 11:10:46.194325 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 11:10:46.252434 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 11:10:46.338121 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 11:10:46.374195 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 11:10:46.883484 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 11:10:46.889131 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:10:46.900735 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:10:46.943295 tst handover.py: using LAC 40511 11:10:47.103976 tst handover.py: using RAC 221 11:10:47.229458 tst handover.py: using CellId 40511 11:10:47.351188 tst handover.py: using BVCI 40512 11:10:47.464822 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:10:47.512140 tst handover.py: using LAC 40512 11:10:47.633256 tst handover.py: using RAC 222 11:10:47.754513 tst handover.py: using CellId 40512 11:10:47.876026 tst handover.py: using BVCI 40513 11:10:47.988364 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:10:47.999203 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:10:48.009967 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:10:48.020485 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:10:48.031519 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:10:48.042928 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:10:48.163229 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:10:48.280745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:48.731919 run create_hlr_db(pid=12124): Launched 11:10:48.848750 bus /sierra_2: Setting Powered False 11:10:49.910361 run create_hlr_db(pid=12124): Terminated: ok {rc=0} 11:10:50.314098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12126): Launched 11:10:50.622793 run osmo-hlr_10.42.42.2(pid=12127): Launched 11:10:50.740838 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:51.259940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12129): Launched 11:10:51.570095 run osmo-stp_10.42.42.5(pid=12130): Launched 11:10:51.687974 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:52.237846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12135): Launched 11:10:52.567989 run osmo-msc_10.42.42.6(pid=12136): Launched 11:10:52.755997 run osmo-stp_10.42.42.5(pid=12130): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12130)] 11:10:52.893745 run osmo-stp_10.42.42.5(pid=12130): stdout: | (launched: 2022-12-14_11:10:51.512720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:53.033373 run osmo-stp_10.42.42.5(pid=12130): stderr: | 20221214111051682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111051682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111051682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111051683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111051683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111051683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111051683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:53.171099 run osmo-stp_10.42.42.5(pid=12130): stdout: | (launched: 2022-12-14_11:10:51.512720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:53.301829 run osmo-stp_10.42.42.5(pid=12130): stderr: | 20221214111051682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111051682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111051682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111051683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111051683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111051683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111051683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:53.458084 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12130): Process ended prematurely: osmo-stp_10.42.42.5(pid=12130) [trial-2403↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12130)] [trial-2403↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 11:10:53.467321 tst handover.py:18: Test FAILED (6.6 sec) 11:10:53.495074 run osmo-hlr_10.42.42.2(pid=12127): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12127)] 11:10:53.545651 run osmo-hlr_10.42.42.2(pid=12127): stdout: | (launched: 2022-12-14_11:10:50.565297) 11:10:53.598116 run osmo-hlr_10.42.42.2(pid=12127): stderr: | 20221214111050743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111050743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111050743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111050743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111050743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111050743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111050754 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111050762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111050762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111050762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:53.671118 run osmo-msc_10.42.42.6(pid=12136): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12136)] 11:10:53.722024 run osmo-msc_10.42.42.6(pid=12136): stdout: | (launched: 2022-12-14_11:10:52.507256) 11:10:53.774105 run osmo-msc_10.42.42.6(pid=12136): stderr: | 20221214111052826 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111052826 DLGLOBAL DEBUG validating counter group 0x7fee9b43ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111052826 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111052826 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111052826 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111052827 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111052828 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111052829 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111052829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111052829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:53.826778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12126): Terminating (SIGTERM) 11:10:53.869048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12129): Terminating (SIGTERM) 11:10:53.911100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12135): Terminating (SIGTERM) 11:10:53.953735 --- ParallelTerminationStrategy: PID 12126 died... 11:10:53.973961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12126): Terminated: ok {rc=0} 11:10:54.020520 --- ParallelTerminationStrategy: PID 12129 died... 11:10:54.040154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12129): Terminated: ok {rc=0} 11:10:54.086371 --- ParallelTerminationStrategy: PID 12135 died... 11:10:54.105983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12135): Terminated: ok {rc=0} 11:10:54.194711 bus /sierra_3: Setting Powered False 11:10:55.294119 bus /sierra_3: Setting Powered False 11:10:56.410634 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:10:57.676576 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:57.682899 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:10:57.733546 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:10:57.760591 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:10:57.816312 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:10:57.868096 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:10:57.895162 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:10:58.441552 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:10:58.447045 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:10:58.458670 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:10:58.498133 tst handover.py: using LAC 40513 11:10:58.621555 tst handover.py: using RAC 223 11:10:58.743282 tst handover.py: using CellId 40513 11:10:58.865379 tst handover.py: using BVCI 40514 11:10:58.979350 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:10:59.024222 tst handover.py: using LAC 40514 11:10:59.146453 tst handover.py: using RAC 224 11:10:59.269672 tst handover.py: using CellId 40514 11:10:59.399416 tst handover.py: using BVCI 40515 11:10:59.520532 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:10:59.532163 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:10:59.543537 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:10:59.554969 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:10:59.566504 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:10:59.577927 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:10:59.702694 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:10:59.824507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:00.307310 run create_hlr_db(pid=12141): Launched 11:11:00.441367 bus /sierra_2: Setting Powered False 11:11:01.501262 run create_hlr_db(pid=12141): Terminated: ok {rc=0} 11:11:01.919337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12143): Launched 11:11:02.247144 run osmo-hlr_10.42.42.2(pid=12144): Launched 11:11:02.369426 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:02.882815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12146): Launched 11:11:03.194620 run osmo-stp_10.42.42.5(pid=12147): Launched 11:11:03.315502 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:03.849542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12149): Launched 11:11:04.160101 run osmo-msc_10.42.42.6(pid=12150): Launched 11:11:04.332761 run osmo-stp_10.42.42.5(pid=12147): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12147)] 11:11:04.463879 run osmo-stp_10.42.42.5(pid=12147): stdout: | (launched: 2022-12-14_11:11:03.137327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:04.594284 run osmo-stp_10.42.42.5(pid=12147): stderr: | 20221214111103307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111103307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111103307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111103308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111103308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111103308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111103308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:04.723136 run osmo-stp_10.42.42.5(pid=12147): stdout: | (launched: 2022-12-14_11:11:03.137327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:04.846209 run osmo-stp_10.42.42.5(pid=12147): stderr: | 20221214111103307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111103307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111103307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111103308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111103308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111103308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111103308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:04.992825 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12147): Process ended prematurely: osmo-stp_10.42.42.5(pid=12147) [trial-2403↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12147)] [trial-2403↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 11:11:05.001516 tst handover.py:18: Test FAILED (6.5 sec) 11:11:05.027805 run osmo-hlr_10.42.42.2(pid=12144): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12144)] 11:11:05.077087 run osmo-hlr_10.42.42.2(pid=12144): stdout: | (launched: 2022-12-14_11:11:02.189778) 11:11:05.126920 run osmo-hlr_10.42.42.2(pid=12144): stderr: | 20221214111102362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111102362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111102362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111102362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111102362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111102362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111102379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111102387 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111102388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111102388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:05.196660 run osmo-msc_10.42.42.6(pid=12150): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12150)] 11:11:05.245106 run osmo-msc_10.42.42.6(pid=12150): stdout: | (launched: 2022-12-14_11:11:04.102775) 11:11:05.295248 run osmo-msc_10.42.42.6(pid=12150): stderr: | 20221214111104370 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111104370 DLGLOBAL DEBUG validating counter group 0x7fc6c8ec7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111104370 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111104370 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111104370 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111104370 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111104372 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111104373 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111104373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111104373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:05.345684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12143): Terminating (SIGTERM) 11:11:05.385853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12146): Terminating (SIGTERM) 11:11:05.426093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12149): Terminating (SIGTERM) 11:11:05.466790 --- ParallelTerminationStrategy: PID 12143 died... 11:11:05.486546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12143): Terminated: ok {rc=0} 11:11:05.531044 --- ParallelTerminationStrategy: PID 12146 died... 11:11:05.550302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12146): Terminated: ok {rc=0} 11:11:05.594811 --- ParallelTerminationStrategy: PID 12149 died... 11:11:05.614036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12149): Terminated: ok {rc=0} 11:11:05.701027 bus /sierra_3: Setting Powered False 11:11:06.800414 bus /sierra_3: Setting Powered False 11:11:07.916858 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:11:09.178797 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:09.184009 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:11:09.238126 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:11:09.264705 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:11:09.315680 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:11:09.370776 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:11:09.398209 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:11:09.949051 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:11:09.954519 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:11:09.965761 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:11:10.002984 tst handover.py: using LAC 40515 11:11:10.123509 tst handover.py: using RAC 225 11:11:10.243126 tst handover.py: using CellId 40515 11:11:10.363500 tst handover.py: using BVCI 40516 11:11:10.475620 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:11:10.522957 tst handover.py: using LAC 40516 11:11:10.641689 tst handover.py: using RAC 226 11:11:10.767559 tst handover.py: using CellId 40516 11:11:10.899413 tst handover.py: using BVCI 40517 11:11:11.020623 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:11:11.032042 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:11:11.043528 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:11:11.055069 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:11:11.066613 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:11:11.077859 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:11:11.196376 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:11:11.317641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:11.797705 run create_hlr_db(pid=12155): Launched 11:11:11.931442 bus /sierra_2: Setting Powered False 11:11:12.996693 run create_hlr_db(pid=12155): Terminated: ok {rc=0} 11:11:13.410574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12157): Launched 11:11:13.718723 run osmo-hlr_10.42.42.2(pid=12158): Launched 11:11:13.838628 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:14.346789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12160): Launched 11:11:14.655624 run osmo-stp_10.42.42.5(pid=12161): Launched 11:11:14.774130 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:15.305647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12163): Launched 11:11:15.614159 run osmo-msc_10.42.42.6(pid=12164): Launched 11:11:15.786259 run osmo-stp_10.42.42.5(pid=12161): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12161)] 11:11:15.999788 run osmo-stp_10.42.42.5(pid=12161): stdout: | (launched: 2022-12-14_11:11:14.598161) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:16.197375 run osmo-stp_10.42.42.5(pid=12161): stderr: | 20221214111114768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111114769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111114769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111114769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111114770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111114770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111114770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:16.329069 run osmo-stp_10.42.42.5(pid=12161): stdout: | (launched: 2022-12-14_11:11:14.598161) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:16.454707 run osmo-stp_10.42.42.5(pid=12161): stderr: | 20221214111114768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111114769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111114769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111114769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111114770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111114770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111114770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:16.604877 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12161): Process ended prematurely: osmo-stp_10.42.42.5(pid=12161) [trial-2403↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12161)] [trial-2403↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 11:11:16.614518 tst handover.py:18: Test FAILED (6.7 sec) 11:11:16.641909 run osmo-hlr_10.42.42.2(pid=12158): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12158)] 11:11:16.693775 run osmo-hlr_10.42.42.2(pid=12158): stdout: | (launched: 2022-12-14_11:11:13.660868) 11:11:16.746967 run osmo-hlr_10.42.42.2(pid=12158): stderr: | 20221214111113836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111113836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111113836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111113836 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111113836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111113836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111113848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111113856 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111113856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111113856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:16.819374 run osmo-msc_10.42.42.6(pid=12164): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12164)] 11:11:16.868669 run osmo-msc_10.42.42.6(pid=12164): stdout: | (launched: 2022-12-14_11:11:15.557069) 11:11:16.921847 run osmo-msc_10.42.42.6(pid=12164): stderr: | 20221214111115833 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111115833 DLGLOBAL DEBUG validating counter group 0x7f34bf328c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111115833 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111115834 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111115834 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111115834 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111115836 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111115836 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111115836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111115836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:16.974607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12157): Terminating (SIGTERM) 11:11:17.016334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12160): Terminating (SIGTERM) 11:11:17.058479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12163): Terminating (SIGTERM) 11:11:17.100781 --- ParallelTerminationStrategy: PID 12157 died... 11:11:17.122034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12157): Terminated: ok {rc=0} 11:11:17.168615 --- ParallelTerminationStrategy: PID 12160 died... 11:11:17.189510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12160): Terminated: ok {rc=0} 11:11:17.236035 --- ParallelTerminationStrategy: PID 12163 died... 11:11:17.256874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12163): Terminated: ok {rc=0} 11:11:17.346072 bus /sierra_3: Setting Powered False 11:11:18.443999 bus /sierra_3: Setting Powered False 11:11:19.560014 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 11:11:20.820721 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:20.826025 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:11:20.867931 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:11:20.894698 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:11:20.947309 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:11:20.989357 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:11:21.016511 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:11:21.562700 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 11:11:21.567932 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:21.578816 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 11:11:21.616536 tst handover.py: using LAC 40517 11:11:21.747001 tst handover.py: using RAC 227 11:11:21.876813 tst handover.py: using CellId 40517 11:11:22.005633 tst handover.py: using BVCI 40518 11:11:22.118169 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 11:11:22.153408 tst handover.py: using LAC 40518 11:11:22.277706 tst handover.py: using RAC 228 11:11:22.408124 tst handover.py: using CellId 40518 11:11:22.537661 tst handover.py: using BVCI 40519 11:11:22.656542 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:22.668032 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:22.679436 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:22.690570 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:22.701801 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:22.712885 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 11:11:22.834046 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 11:11:22.952191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:23.404578 run create_hlr_db(pid=12169): Launched 11:11:23.523505 bus /sierra_2: Setting Powered False 11:11:24.583872 run create_hlr_db(pid=12169): Terminated: ok {rc=0} 11:11:25.007294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12171): Launched 11:11:25.335524 run osmo-hlr_10.42.42.2(pid=12172): Launched 11:11:25.463061 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:25.999942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12174): Launched 11:11:26.329794 run osmo-stp_10.42.42.5(pid=12175): Launched 11:11:26.455454 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:27.020753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12177): Launched 11:11:27.351021 run osmo-msc_10.42.42.6(pid=12178): Launched 11:11:27.536922 run osmo-stp_10.42.42.5(pid=12175): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12175)] 11:11:27.675612 run osmo-stp_10.42.42.5(pid=12175): stdout: | (launched: 2022-12-14_11:11:26.269043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:27.814658 run osmo-stp_10.42.42.5(pid=12175): stderr: | 20221214111126460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111126460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111126460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111126461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111126461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111126462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111126462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:27.951477 run osmo-stp_10.42.42.5(pid=12175): stdout: | (launched: 2022-12-14_11:11:26.269043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:28.081789 run osmo-stp_10.42.42.5(pid=12175): stderr: | 20221214111126460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111126460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111126460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111126461 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111126461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111126462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111126462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:28.237750 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12175): Process ended prematurely: osmo-stp_10.42.42.5(pid=12175) [trial-2403↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12175)] [trial-2403↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 11:11:28.246946 tst handover.py:18: Test FAILED (6.7 sec) 11:11:28.274717 run osmo-hlr_10.42.42.2(pid=12172): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12172)] 11:11:28.324893 run osmo-hlr_10.42.42.2(pid=12172): stdout: | (launched: 2022-12-14_11:11:25.275128) 11:11:28.377359 run osmo-hlr_10.42.42.2(pid=12172): stderr: | 20221214111125473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111125473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111125473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111125473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111125473 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111125473 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111125485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111125494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111125494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111125494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:28.450309 run osmo-msc_10.42.42.6(pid=12178): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12178)] 11:11:28.500511 run osmo-msc_10.42.42.6(pid=12178): stdout: | (launched: 2022-12-14_11:11:27.289993) 11:11:28.552533 run osmo-msc_10.42.42.6(pid=12178): stderr: | 20221214111127610 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111127610 DLGLOBAL DEBUG validating counter group 0x7f8b3c48bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111127610 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111127610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111127610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111127611 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111127612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111127613 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111127613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111127613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:28.605142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12171): Terminating (SIGTERM) 11:11:28.647156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12174): Terminating (SIGTERM) 11:11:28.689896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12177): Terminating (SIGTERM) 11:11:28.732436 --- ParallelTerminationStrategy: PID 12171 died... 11:11:28.752698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12171): Terminated: ok {rc=0} 11:11:28.799152 --- ParallelTerminationStrategy: PID 12174 died... 11:11:28.818862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12174): Terminated: ok {rc=0} 11:11:28.864925 --- ParallelTerminationStrategy: PID 12177 died... 11:11:28.884765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12177): Terminated: ok {rc=0} 11:11:28.972663 bus /sierra_3: Setting Powered False 11:11:30.071544 bus /sierra_3: Setting Powered False 11:11:31.185953 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 11:11:32.429657 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:32.435221 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:11:32.488648 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:11:32.514926 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:11:32.566137 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:11:32.618913 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:11:32.644942 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:11:33.196302 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 11:11:33.201792 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:33.212666 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:11:33.250681 tst handover.py: using LAC 40519 11:11:33.371417 tst handover.py: using RAC 229 11:11:33.497484 tst handover.py: using CellId 40519 11:11:33.621384 tst handover.py: using BVCI 40520 11:11:33.735366 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:11:33.782135 tst handover.py: using LAC 40520 11:11:33.903442 tst handover.py: using RAC 230 11:11:34.021788 tst handover.py: using CellId 40520 11:11:34.150410 tst handover.py: using BVCI 40521 11:11:34.262593 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:34.273804 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:34.284626 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:34.295496 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:34.306784 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:34.318029 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:11:34.438916 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:11:34.556761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:35.007969 run create_hlr_db(pid=12184): Launched 11:11:35.124775 bus /sierra_2: Setting Powered False 11:11:36.186240 run create_hlr_db(pid=12184): Terminated: ok {rc=0} 11:11:36.610635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12186): Launched 11:11:36.939847 run osmo-hlr_10.42.42.2(pid=12187): Launched 11:11:37.067479 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:37.610631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12189): Launched 11:11:37.940910 run osmo-stp_10.42.42.5(pid=12190): Launched 11:11:38.068220 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:38.635013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12192): Launched 11:11:38.965723 run osmo-msc_10.42.42.6(pid=12193): Launched 11:11:39.149743 run osmo-stp_10.42.42.5(pid=12190): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12190)] 11:11:39.288088 run osmo-stp_10.42.42.5(pid=12190): stdout: | (launched: 2022-12-14_11:11:37.880059) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:39.427620 run osmo-stp_10.42.42.5(pid=12190): stderr: | 20221214111138071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111138071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111138071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111138071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111138072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111138072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111138072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:39.565548 run osmo-stp_10.42.42.5(pid=12190): stdout: | (launched: 2022-12-14_11:11:37.880059) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:39.695724 run osmo-stp_10.42.42.5(pid=12190): stderr: | 20221214111138071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111138071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111138071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111138071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111138072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111138072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111138072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:39.851483 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12190): Process ended prematurely: osmo-stp_10.42.42.5(pid=12190) [trial-2403↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12190)] [trial-2403↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 11:11:39.860460 tst handover.py:18: Test FAILED (6.7 sec) 11:11:39.888104 run osmo-hlr_10.42.42.2(pid=12187): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12187)] 11:11:39.938636 run osmo-hlr_10.42.42.2(pid=12187): stdout: | (launched: 2022-12-14_11:11:36.879291) 11:11:39.992233 run osmo-hlr_10.42.42.2(pid=12187): stderr: | 20221214111137077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111137077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111137077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111137077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111137077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111137078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111137090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111137101 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111137101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111137101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:40.062962 run osmo-msc_10.42.42.6(pid=12193): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12193)] 11:11:40.110684 run osmo-msc_10.42.42.6(pid=12193): stdout: | (launched: 2022-12-14_11:11:38.904311) 11:11:40.161340 run osmo-msc_10.42.42.6(pid=12193): stderr: | 20221214111139224 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111139224 DLGLOBAL DEBUG validating counter group 0x7fef82052c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111139224 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111139224 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111139224 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111139225 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111139226 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111139227 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111139227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111139227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:40.211935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12186): Terminating (SIGTERM) 11:11:40.252985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12189): Terminating (SIGTERM) 11:11:40.293568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12192): Terminating (SIGTERM) 11:11:40.334506 --- ParallelTerminationStrategy: PID 12186 died... 11:11:40.354220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12186): Terminated: ok {rc=0} 11:11:40.399129 --- ParallelTerminationStrategy: PID 12189 died... 11:11:40.418727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12189): Terminated: ok {rc=0} 11:11:40.463419 --- ParallelTerminationStrategy: PID 12192 died... 11:11:40.482950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12192): Terminated: ok {rc=0} 11:11:40.571243 bus /sierra_3: Setting Powered False 11:11:41.673163 bus /sierra_3: Setting Powered False 11:11:42.789489 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 11:11:44.054198 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:44.059833 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:11:44.114195 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:11:44.141468 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:11:44.195271 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:11:44.250128 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:11:44.277338 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:11:44.823084 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 11:11:44.829410 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:44.840685 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:11:44.878989 tst handover.py: using LAC 40521 11:11:45.001150 tst handover.py: using RAC 231 11:11:45.134508 tst handover.py: using CellId 40521 11:11:45.256058 tst handover.py: using BVCI 40522 11:11:45.367365 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:11:45.413636 tst handover.py: using LAC 40522 11:11:45.534451 tst handover.py: using RAC 232 11:11:45.654579 tst handover.py: using CellId 40522 11:11:45.774518 tst handover.py: using BVCI 40523 11:11:45.907630 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:45.924223 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:45.942459 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:45.954877 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:45.973485 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:45.986506 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:11:46.135829 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:11:46.258402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:46.724116 run create_hlr_db(pid=12198): Launched 11:11:46.891322 bus /sierra_2: Setting Powered False 11:11:47.955382 run create_hlr_db(pid=12198): Terminated: ok {rc=0} 11:11:48.386200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12200): Launched 11:11:48.716479 run osmo-hlr_10.42.42.2(pid=12201): Launched 11:11:48.843250 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:49.385681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12203): Launched 11:11:49.715956 run osmo-stp_10.42.42.5(pid=12204): Launched 11:11:49.843118 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:50.413088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12206): Launched 11:11:50.742618 run osmo-msc_10.42.42.6(pid=12207): Launched 11:11:50.926767 run osmo-stp_10.42.42.5(pid=12204): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12204)] 11:11:51.064899 run osmo-stp_10.42.42.5(pid=12204): stdout: | (launched: 2022-12-14_11:11:49.655309) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:51.203353 run osmo-stp_10.42.42.5(pid=12204): stderr: | 20221214111149844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111149844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111149844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111149845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111149845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111149845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111149845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:51.339829 run osmo-stp_10.42.42.5(pid=12204): stdout: | (launched: 2022-12-14_11:11:49.655309) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:51.470009 run osmo-stp_10.42.42.5(pid=12204): stderr: | 20221214111149844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111149844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111149844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111149845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111149845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111149845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111149845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:51.626733 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12204): Process ended prematurely: osmo-stp_10.42.42.5(pid=12204) [trial-2403↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12204)] [trial-2403↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 11:11:51.635657 tst handover.py:18: Test FAILED (6.8 sec) 11:11:51.663304 run osmo-hlr_10.42.42.2(pid=12201): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12201)] 11:11:51.713904 run osmo-hlr_10.42.42.2(pid=12201): stdout: | (launched: 2022-12-14_11:11:48.655906) 11:11:51.766465 run osmo-hlr_10.42.42.2(pid=12201): stderr: | 20221214111148852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111148852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111148852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111148852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111148852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111148852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111148864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111148873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111148873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111148873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:51.839389 run osmo-msc_10.42.42.6(pid=12207): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12207)] 11:11:51.889771 run osmo-msc_10.42.42.6(pid=12207): stdout: | (launched: 2022-12-14_11:11:50.681873) 11:11:51.941948 run osmo-msc_10.42.42.6(pid=12207): stderr: | 20221214111151002 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111151002 DLGLOBAL DEBUG validating counter group 0x7f713426ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111151002 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111151002 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111151002 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111151003 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111151004 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111151005 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111151005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111151005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:51.995154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12200): Terminating (SIGTERM) 11:11:52.037541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12203): Terminating (SIGTERM) 11:11:52.079647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12206): Terminating (SIGTERM) 11:11:52.121946 --- ParallelTerminationStrategy: PID 12200 died... 11:11:52.142212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12200): Terminated: ok {rc=0} 11:11:52.188686 --- ParallelTerminationStrategy: PID 12203 died... 11:11:52.208382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12203): Terminated: ok {rc=0} 11:11:52.254641 --- ParallelTerminationStrategy: PID 12206 died... 11:11:52.274280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12206): Terminated: ok {rc=0} 11:11:52.361879 bus /sierra_3: Setting Powered False 11:11:53.461626 bus /sierra_3: Setting Powered False 11:11:54.578149 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 11:11:55.841504 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:55.847209 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 11:11:55.884851 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 11:11:55.912599 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 11:11:55.967583 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 11:11:56.006090 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 11:11:56.033415 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 11:11:56.583986 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 11:11:56.589737 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:11:56.601205 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 11:11:56.639316 tst handover.py: using LAC 40523 11:11:56.768536 tst handover.py: using RAC 233 11:11:56.895077 tst handover.py: using CellId 40523 11:11:57.021872 tst handover.py: using BVCI 40524 11:11:57.140526 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 11:11:57.174100 tst handover.py: using LAC 40524 11:11:57.300865 tst handover.py: using RAC 234 11:11:57.427447 tst handover.py: using CellId 40524 11:11:57.554113 tst handover.py: using BVCI 40525 11:11:57.673477 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:11:57.684747 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:11:57.695842 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:11:57.707235 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:11:57.718533 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:11:57.729851 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 11:11:57.848536 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 11:11:57.971748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:58.455486 run create_hlr_db(pid=12212): Launched 11:11:58.590118 bus /sierra_2: Setting Powered False 11:11:59.655063 run create_hlr_db(pid=12212): Terminated: ok {rc=0} 11:12:00.086762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12214): Launched 11:12:00.418584 run osmo-hlr_10.42.42.2(pid=12215): Launched 11:12:00.545807 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:01.104438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12217): Launched 11:12:01.439635 run osmo-stp_10.42.42.5(pid=12218): Launched 11:12:01.731987 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:02.336587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12220): Launched 11:12:02.646899 run osmo-msc_10.42.42.6(pid=12221): Launched 11:12:02.823207 run osmo-stp_10.42.42.5(pid=12218): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12218)] 11:12:02.953408 run osmo-stp_10.42.42.5(pid=12218): stdout: | (launched: 2022-12-14_11:12:01.379418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:03.083104 run osmo-stp_10.42.42.5(pid=12218): stderr: | 20221214111201588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111201588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111201588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111201591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111201592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111201592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111201592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:03.211898 run osmo-stp_10.42.42.5(pid=12218): stdout: | (launched: 2022-12-14_11:12:01.379418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:03.334674 run osmo-stp_10.42.42.5(pid=12218): stderr: | 20221214111201588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111201588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111201588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111201591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111201592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111201592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111201592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:03.481811 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12218): Process ended prematurely: osmo-stp_10.42.42.5(pid=12218) [trial-2403↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12218)] [trial-2403↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 11:12:03.490537 tst handover.py:18: Test FAILED (6.9 sec) 11:12:03.516889 run osmo-hlr_10.42.42.2(pid=12215): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12215)] 11:12:03.565489 run osmo-hlr_10.42.42.2(pid=12215): stdout: | (launched: 2022-12-14_11:12:00.357883) 11:12:03.615393 run osmo-hlr_10.42.42.2(pid=12215): stderr: | 20221214111200554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111200554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111200554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111200554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111200554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111200554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111200566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111200575 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111200575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111200575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:03.685371 run osmo-msc_10.42.42.6(pid=12221): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12221)] 11:12:03.733517 run osmo-msc_10.42.42.6(pid=12221): stdout: | (launched: 2022-12-14_11:12:02.589601) 11:12:03.783064 run osmo-msc_10.42.42.6(pid=12221): stderr: | 20221214111202858 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111202858 DLGLOBAL DEBUG validating counter group 0x7ffa0798cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111202858 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111202858 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111202859 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111202859 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111202860 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111202861 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111202861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111202861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:03.833287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12214): Terminating (SIGTERM) 11:12:03.873483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12217): Terminating (SIGTERM) 11:12:03.913716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12220): Terminating (SIGTERM) 11:12:03.954098 --- ParallelTerminationStrategy: PID 12214 died... 11:12:03.973845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12214): Terminated: ok {rc=0} 11:12:04.018232 --- ParallelTerminationStrategy: PID 12217 died... 11:12:04.037338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12217): Terminated: ok {rc=0} 11:12:04.081413 --- ParallelTerminationStrategy: PID 12220 died... 11:12:04.100565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12220): Terminated: ok {rc=0} 11:12:04.187389 bus /sierra_3: Setting Powered False 11:12:05.285872 bus /sierra_3: Setting Powered False 11:12:06.398324 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 11:12:07.641463 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:07.647098 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 11:12:07.698443 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 11:12:07.725922 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 11:12:07.779397 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 11:12:07.829988 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 11:12:07.856291 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 11:12:08.408610 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 11:12:08.414315 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:12:08.425727 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:12:08.460372 tst handover.py: using LAC 40525 11:12:08.589045 tst handover.py: using RAC 235 11:12:08.718577 tst handover.py: using CellId 40525 11:12:08.839590 tst handover.py: using BVCI 40526 11:12:08.951346 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:12:08.998955 tst handover.py: using LAC 40526 11:12:09.121724 tst handover.py: using RAC 236 11:12:09.243948 tst handover.py: using CellId 40526 11:12:09.366849 tst handover.py: using BVCI 40527 11:12:09.486478 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:12:09.497918 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:12:09.509225 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:12:09.520474 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:12:09.531663 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:12:09.542958 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:12:09.660764 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:12:09.782577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:10.265638 run create_hlr_db(pid=12226): Launched 11:12:10.399159 bus /sierra_2: Setting Powered False 11:12:11.464609 run create_hlr_db(pid=12226): Terminated: ok {rc=0} 11:12:11.881898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12228): Launched 11:12:12.193800 run osmo-hlr_10.42.42.2(pid=12229): Launched 11:12:12.311261 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:12.828253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12231): Launched 11:12:13.139463 run osmo-stp_10.42.42.5(pid=12232): Launched 11:12:13.259692 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:13.790958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12234): Launched 11:12:14.103201 run osmo-msc_10.42.42.6(pid=12235): Launched 11:12:14.277551 run osmo-stp_10.42.42.5(pid=12232): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12232)] 11:12:14.407863 run osmo-stp_10.42.42.5(pid=12232): stdout: | (launched: 2022-12-14_11:12:13.081995) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:14.538452 run osmo-stp_10.42.42.5(pid=12232): stderr: | 20221214111213251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111213251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111213252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111213252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111213252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111213253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111213253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:14.666928 run osmo-stp_10.42.42.5(pid=12232): stdout: | (launched: 2022-12-14_11:12:13.081995) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:14.788785 run osmo-stp_10.42.42.5(pid=12232): stderr: | 20221214111213251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111213251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111213252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111213252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111213252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111213253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111213253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:14.935163 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12232): Process ended prematurely: osmo-stp_10.42.42.5(pid=12232) [trial-2403↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12232)] [trial-2403↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 11:12:14.943554 tst handover.py:18: Test FAILED (6.5 sec) 11:12:14.969705 run osmo-hlr_10.42.42.2(pid=12229): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12229)] 11:12:15.018117 run osmo-hlr_10.42.42.2(pid=12229): stdout: | (launched: 2022-12-14_11:12:12.135867) 11:12:15.068001 run osmo-hlr_10.42.42.2(pid=12229): stderr: | 20221214111212310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111212310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111212310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111212310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111212310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111212310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111212322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111212330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111212330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111212330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:15.137872 run osmo-msc_10.42.42.6(pid=12235): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12235)] 11:12:15.185414 run osmo-msc_10.42.42.6(pid=12235): stdout: | (launched: 2022-12-14_11:12:14.045440) 11:12:15.234937 run osmo-msc_10.42.42.6(pid=12235): stderr: | 20221214111214314 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111214314 DLGLOBAL DEBUG validating counter group 0x7f1ec5677c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111214314 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111214314 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111214315 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111214315 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111214316 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111214317 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111214317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111214317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:15.285362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12228): Terminating (SIGTERM) 11:12:15.325094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12231): Terminating (SIGTERM) 11:12:15.364605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12234): Terminating (SIGTERM) 11:12:15.404676 --- ParallelTerminationStrategy: PID 12228 died... 11:12:15.424180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12228): Terminated: ok {rc=0} 11:12:15.468286 --- ParallelTerminationStrategy: PID 12231 died... 11:12:15.487204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12231): Terminated: ok {rc=0} 11:12:15.531058 --- ParallelTerminationStrategy: PID 12234 died... 11:12:15.550066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12234): Terminated: ok {rc=0} 11:12:15.636262 bus /sierra_3: Setting Powered False 11:12:16.736675 bus /sierra_3: Setting Powered False 11:12:17.857969 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:12:19.111004 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:19.116264 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:12:19.163816 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:12:19.190132 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:12:19.242808 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:12:19.289291 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:12:19.315543 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:12:19.866594 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:12:19.872058 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:12:19.883247 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:12:19.920485 tst handover.py: using LAC 40527 11:12:20.041997 tst handover.py: using RAC 237 11:12:20.162650 tst handover.py: using CellId 40527 11:12:20.283413 tst handover.py: using BVCI 40528 11:12:20.395764 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:12:20.438550 tst handover.py: using LAC 40528 11:12:20.559165 tst handover.py: using RAC 238 11:12:20.678377 tst handover.py: using CellId 40528 11:12:20.799164 tst handover.py: using BVCI 40529 11:12:20.911007 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:12:20.922181 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:12:20.933328 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:12:20.944248 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:12:20.956095 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:12:20.967780 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:12:21.093343 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:12:21.214828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:21.667576 run create_hlr_db(pid=12240): Launched 11:12:21.787688 bus /sierra_2: Setting Powered False 11:12:22.848594 run create_hlr_db(pid=12240): Terminated: ok {rc=0} 11:12:23.254382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12242): Launched 11:12:23.563086 run osmo-hlr_10.42.42.2(pid=12243): Launched 11:12:23.681080 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:24.201208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12245): Launched 11:12:24.510123 run osmo-stp_10.42.42.5(pid=12246): Launched 11:12:24.628444 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:25.159708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12248): Launched 11:12:25.470458 run osmo-msc_10.42.42.6(pid=12249): Launched 11:12:25.645251 run osmo-stp_10.42.42.5(pid=12246): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12246)] 11:12:25.775264 run osmo-stp_10.42.42.5(pid=12246): stdout: | (launched: 2022-12-14_11:12:24.452880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:25.905841 run osmo-stp_10.42.42.5(pid=12246): stderr: | 20221214111224621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111224621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111224621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111224621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111224622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111224622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111224622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:26.034492 run osmo-stp_10.42.42.5(pid=12246): stdout: | (launched: 2022-12-14_11:12:24.452880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:26.157104 run osmo-stp_10.42.42.5(pid=12246): stderr: | 20221214111224621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111224621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111224621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111224621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111224622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111224622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111224622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:26.303298 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12246): Process ended prematurely: osmo-stp_10.42.42.5(pid=12246) [trial-2403↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12246)] [trial-2403↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 11:12:26.311866 tst handover.py:18: Test FAILED (6.4 sec) 11:12:26.338329 run osmo-hlr_10.42.42.2(pid=12243): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12243)] 11:12:26.386869 run osmo-hlr_10.42.42.2(pid=12243): stdout: | (launched: 2022-12-14_11:12:23.505866) 11:12:26.437137 run osmo-hlr_10.42.42.2(pid=12243): stderr: | 20221214111223679 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111223679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111223679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111223679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111223680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111223680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111223692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111223700 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111223700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111223700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:26.506825 run osmo-msc_10.42.42.6(pid=12249): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12249)] 11:12:26.554198 run osmo-msc_10.42.42.6(pid=12249): stdout: | (launched: 2022-12-14_11:12:25.412679) 11:12:26.604172 run osmo-msc_10.42.42.6(pid=12249): stderr: | 20221214111225682 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111225682 DLGLOBAL DEBUG validating counter group 0x7faf07520c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111225682 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111225682 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111225682 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111225682 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111225684 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111225684 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111225685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111225685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:26.654334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12242): Terminating (SIGTERM) 11:12:26.694311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12245): Terminating (SIGTERM) 11:12:26.734369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12248): Terminating (SIGTERM) 11:12:26.774478 --- ParallelTerminationStrategy: PID 12242 died... 11:12:26.794275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12242): Terminated: ok {rc=0} 11:12:26.838546 --- ParallelTerminationStrategy: PID 12245 died... 11:12:26.857545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12245): Terminated: ok {rc=0} 11:12:26.901559 --- ParallelTerminationStrategy: PID 12248 died... 11:12:26.920421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12248): Terminated: ok {rc=0} 11:12:27.006967 bus /sierra_3: Setting Powered False 11:12:28.107379 bus /sierra_3: Setting Powered False 11:12:29.224045 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:12:30.483757 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:30.490018 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:12:30.542213 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:12:30.569438 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:12:30.623062 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:12:30.675372 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:12:30.702506 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:12:31.253818 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:12:31.260814 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:12:31.272737 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:12:31.312136 tst handover.py: using LAC 40529 11:12:31.471698 tst handover.py: using RAC 239 11:12:31.596854 tst handover.py: using CellId 40529 11:12:31.770061 tst handover.py: using BVCI 40530 11:12:31.925455 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:12:31.984829 tst handover.py: using LAC 40530 11:12:32.144724 tst handover.py: using RAC 240 11:12:32.270125 tst handover.py: using CellId 40530 11:12:32.392864 tst handover.py: using BVCI 40531 11:12:32.508108 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:12:32.519297 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:12:32.530610 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:12:32.541636 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:12:32.552754 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:12:32.564042 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:12:32.685493 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:12:32.806497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:33.290250 run create_hlr_db(pid=12254): Launched 11:12:33.426832 bus /sierra_2: Setting Powered False 11:12:34.490681 run create_hlr_db(pid=12254): Terminated: ok {rc=0} 11:12:34.907046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12256): Launched 11:12:35.218786 run osmo-hlr_10.42.42.2(pid=12257): Launched 11:12:35.337381 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:35.857114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12259): Launched 11:12:36.166152 run osmo-stp_10.42.42.5(pid=12260): Launched 11:12:36.283989 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:36.815261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12262): Launched 11:12:37.125184 run osmo-msc_10.42.42.6(pid=12263): Launched 11:12:37.297674 run osmo-stp_10.42.42.5(pid=12260): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12260)] 11:12:37.427843 run osmo-stp_10.42.42.5(pid=12260): stdout: | (launched: 2022-12-14_11:12:36.108852) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:37.557569 run osmo-stp_10.42.42.5(pid=12260): stderr: | 20221214111236278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111236278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111236279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111236279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111236279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111236280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111236280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:37.685898 run osmo-stp_10.42.42.5(pid=12260): stdout: | (launched: 2022-12-14_11:12:36.108852) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:37.808117 run osmo-stp_10.42.42.5(pid=12260): stderr: | 20221214111236278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111236278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111236279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111236279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111236279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111236280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111236280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:37.954733 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12260): Process ended prematurely: osmo-stp_10.42.42.5(pid=12260) [trial-2403↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12260)] [trial-2403↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 11:12:37.963435 tst handover.py:18: Test FAILED (6.7 sec) 11:12:37.990019 run osmo-hlr_10.42.42.2(pid=12257): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12257)] 11:12:38.038185 run osmo-hlr_10.42.42.2(pid=12257): stdout: | (launched: 2022-12-14_11:12:35.161290) 11:12:38.087988 run osmo-hlr_10.42.42.2(pid=12257): stderr: | 20221214111235335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111235335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111235335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111235335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111235335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111235335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111235347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111235355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111235355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111235355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:38.158100 run osmo-msc_10.42.42.6(pid=12263): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12263)] 11:12:38.206506 run osmo-msc_10.42.42.6(pid=12263): stdout: | (launched: 2022-12-14_11:12:37.067535) 11:12:38.256168 run osmo-msc_10.42.42.6(pid=12263): stderr: | 20221214111237337 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111237337 DLGLOBAL DEBUG validating counter group 0x7fa88ac98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111237337 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111237337 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111237337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111237338 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111237339 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111237340 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111237340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111237340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:38.306191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12256): Terminating (SIGTERM) 11:12:38.346405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12259): Terminating (SIGTERM) 11:12:38.386553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12262): Terminating (SIGTERM) 11:12:38.426733 --- ParallelTerminationStrategy: PID 12256 died... 11:12:38.446343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12256): Terminated: ok {rc=0} 11:12:38.490556 --- ParallelTerminationStrategy: PID 12259 died... 11:12:38.509466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12259): Terminated: ok {rc=0} 11:12:38.553673 --- ParallelTerminationStrategy: PID 12262 died... 11:12:38.572585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12262): Terminated: ok {rc=0} 11:12:38.659435 bus /sierra_3: Setting Powered False 11:12:39.759302 bus /sierra_3: Setting Powered False 11:12:40.876202 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 11:12:42.139710 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:42.145889 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:12:42.185160 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:12:42.211852 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:12:42.267744 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:12:42.305831 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:12:42.333032 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:12:42.876906 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 11:12:42.882404 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:12:42.893402 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 11:12:42.927350 tst handover.py: using LAC 40531 11:12:43.057019 tst handover.py: using RAC 241 11:12:43.185634 tst handover.py: using CellId 40531 11:12:43.313542 tst handover.py: using BVCI 40532 11:12:43.427190 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 11:12:43.461412 tst handover.py: using LAC 40532 11:12:43.581146 tst handover.py: using RAC 242 11:12:43.700425 tst handover.py: using CellId 40532 11:12:43.819077 tst handover.py: using BVCI 40533 11:12:43.930690 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:12:43.941504 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:12:43.952146 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:12:43.962933 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:12:43.973931 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:12:43.984834 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 11:12:44.102307 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 11:12:44.223046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:44.705693 run create_hlr_db(pid=12268): Launched 11:12:44.840565 bus /sierra_2: Setting Powered False 11:12:45.922520 run create_hlr_db(pid=12268): Terminated: ok {rc=0} 11:12:46.367183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12270): Launched 11:12:46.721670 run osmo-hlr_10.42.42.2(pid=12271): Launched 11:12:46.872538 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:47.578087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12273): Launched 11:12:47.910692 run osmo-stp_10.42.42.5(pid=12274): Launched 11:12:48.038602 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:48.607359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12276): Launched 11:12:48.938366 run osmo-msc_10.42.42.6(pid=12277): Launched 11:12:49.124146 run osmo-stp_10.42.42.5(pid=12274): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12274)] 11:12:49.262558 run osmo-stp_10.42.42.5(pid=12274): stdout: | (launched: 2022-12-14_11:12:47.849593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:49.401295 run osmo-stp_10.42.42.5(pid=12274): stderr: | 20221214111248040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111248040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111248040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111248041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111248041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111248042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111248042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:49.539031 run osmo-stp_10.42.42.5(pid=12274): stdout: | (launched: 2022-12-14_11:12:47.849593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:49.669895 run osmo-stp_10.42.42.5(pid=12274): stderr: | 20221214111248040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111248040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111248040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111248041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111248041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111248042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111248042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:49.826665 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12274): Process ended prematurely: osmo-stp_10.42.42.5(pid=12274) [trial-2403↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12274)] [trial-2403↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 11:12:49.835931 tst handover.py:18: Test FAILED (6.9 sec) 11:12:49.864167 run osmo-hlr_10.42.42.2(pid=12271): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12271)] 11:12:49.915388 run osmo-hlr_10.42.42.2(pid=12271): stdout: | (launched: 2022-12-14_11:12:46.651150) 11:12:49.968400 run osmo-hlr_10.42.42.2(pid=12271): stderr: | 20221214111246994 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111246994 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111246994 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111246994 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111246994 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111246994 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111247011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111247027 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111247027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111247027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:50.041926 run osmo-msc_10.42.42.6(pid=12277): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12277)] 11:12:50.093116 run osmo-msc_10.42.42.6(pid=12277): stdout: | (launched: 2022-12-14_11:12:48.877516) 11:12:50.145472 run osmo-msc_10.42.42.6(pid=12277): stderr: | 20221214111249197 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111249197 DLGLOBAL DEBUG validating counter group 0x7f4251b37c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111249197 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111249197 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111249197 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111249197 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111249200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111249200 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111249201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111249201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:50.198169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12270): Terminating (SIGTERM) 11:12:50.240613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12273): Terminating (SIGTERM) 11:12:50.283282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12276): Terminating (SIGTERM) 11:12:50.326235 --- ParallelTerminationStrategy: PID 12270 died... 11:12:50.346903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12270): Terminated: ok {rc=0} 11:12:50.394061 --- ParallelTerminationStrategy: PID 12273 died... 11:12:50.414280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12273): Terminated: ok {rc=0} 11:12:50.460848 --- ParallelTerminationStrategy: PID 12276 died... 11:12:50.481306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12276): Terminated: ok {rc=0} 11:12:50.570895 bus /sierra_3: Setting Powered False 11:12:51.670705 bus /sierra_3: Setting Powered False 11:12:52.787048 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 11:12:54.030819 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:54.036781 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:12:54.088915 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:12:54.117141 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:12:54.172077 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:12:54.222820 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:12:54.249343 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:12:54.801351 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 11:12:54.807288 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:12:54.818287 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:12:54.852772 tst handover.py: using LAC 40533 11:12:54.977742 tst handover.py: using RAC 243 11:12:55.099478 tst handover.py: using CellId 40533 11:12:55.218649 tst handover.py: using BVCI 40534 11:12:55.331565 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:12:55.378516 tst handover.py: using LAC 40534 11:12:55.499629 tst handover.py: using RAC 244 11:12:55.619636 tst handover.py: using CellId 40534 11:12:55.739468 tst handover.py: using BVCI 40535 11:12:55.853328 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:12:55.864248 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:12:55.875143 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:12:55.885958 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:12:55.897352 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:12:55.908334 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:12:56.030868 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:12:56.151863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:56.635232 run create_hlr_db(pid=12282): Launched 11:12:56.771772 bus /sierra_2: Setting Powered False 11:12:57.836818 run create_hlr_db(pid=12282): Terminated: ok {rc=0} 11:12:58.253661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12284): Launched 11:12:58.563404 run osmo-hlr_10.42.42.2(pid=12285): Launched 11:12:58.682617 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:59.188023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12287): Launched 11:12:59.497308 run osmo-stp_10.42.42.5(pid=12288): Launched 11:12:59.616657 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:00.150703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12290): Launched 11:13:00.462289 run osmo-msc_10.42.42.6(pid=12291): Launched 11:13:00.635527 run osmo-stp_10.42.42.5(pid=12288): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12288)] 11:13:00.765755 run osmo-stp_10.42.42.5(pid=12288): stdout: | (launched: 2022-12-14_11:12:59.439788) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:00.929875 run osmo-stp_10.42.42.5(pid=12288): stderr: | 20221214111259609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111259609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111259610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111259610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111259610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111259610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111259611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:01.063355 run osmo-stp_10.42.42.5(pid=12288): stdout: | (launched: 2022-12-14_11:12:59.439788) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:01.190312 run osmo-stp_10.42.42.5(pid=12288): stderr: | 20221214111259609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111259609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111259610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111259610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111259610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111259610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111259611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:01.342554 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12288): Process ended prematurely: osmo-stp_10.42.42.5(pid=12288) [trial-2403↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12288)] [trial-2403↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 11:13:01.352294 tst handover.py:18: Test FAILED (6.5 sec) 11:13:01.380385 run osmo-hlr_10.42.42.2(pid=12285): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12285)] 11:13:01.432887 run osmo-hlr_10.42.42.2(pid=12285): stdout: | (launched: 2022-12-14_11:12:58.506127) 11:13:01.485865 run osmo-hlr_10.42.42.2(pid=12285): stderr: | 20221214111258678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111258679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111258679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111258679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111258679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111258679 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111258691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111258701 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111258701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111258701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:01.559371 run osmo-msc_10.42.42.6(pid=12291): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12291)] 11:13:01.610351 run osmo-msc_10.42.42.6(pid=12291): stdout: | (launched: 2022-12-14_11:13:00.404768) 11:13:01.662948 run osmo-msc_10.42.42.6(pid=12291): stderr: | 20221214111300673 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111300674 DLGLOBAL DEBUG validating counter group 0x7f1684b15c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111300674 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111300674 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111300674 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111300674 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111300676 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111300676 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111300676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111300676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:01.716011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12284): Terminating (SIGTERM) 11:13:01.758084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12287): Terminating (SIGTERM) 11:13:01.800701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12290): Terminating (SIGTERM) 11:13:01.843726 --- ParallelTerminationStrategy: PID 12284 died... 11:13:01.864618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12284): Terminated: ok {rc=0} 11:13:01.911486 --- ParallelTerminationStrategy: PID 12287 died... 11:13:01.932078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12287): Terminated: ok {rc=0} 11:13:01.978620 --- ParallelTerminationStrategy: PID 12290 died... 11:13:01.999311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12290): Terminated: ok {rc=0} 11:13:02.088407 bus /sierra_3: Setting Powered False 11:13:03.185364 bus /sierra_3: Setting Powered False 11:13:04.303186 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 11:13:05.564076 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:05.570634 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:13:05.621293 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:13:05.648538 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:13:05.701832 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:13:05.752859 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:13:05.780242 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:13:06.334991 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 11:13:06.340786 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:13:06.352364 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:13:06.392499 tst handover.py: using LAC 40535 11:13:06.514137 tst handover.py: using RAC 245 11:13:06.635341 tst handover.py: using CellId 40535 11:13:06.754782 tst handover.py: using BVCI 40536 11:13:06.867847 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:13:06.913601 tst handover.py: using LAC 40536 11:13:07.042426 tst handover.py: using RAC 246 11:13:07.170830 tst handover.py: using CellId 40536 11:13:07.298543 tst handover.py: using BVCI 40537 11:13:07.418483 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:13:07.430074 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:13:07.441502 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:13:07.452741 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:13:07.464586 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:13:07.476459 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:13:07.597232 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:13:07.716217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:08.168840 run create_hlr_db(pid=12296): Launched 11:13:08.287952 bus /sierra_2: Setting Powered False 11:13:09.349910 run create_hlr_db(pid=12296): Terminated: ok {rc=0} 11:13:09.774983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12298): Launched 11:13:10.106754 run osmo-hlr_10.42.42.2(pid=12299): Launched 11:13:10.234426 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:10.776442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12301): Launched 11:13:11.108696 run osmo-stp_10.42.42.5(pid=12302): Launched 11:13:11.236616 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:11.804557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12304): Launched 11:13:12.136404 run osmo-msc_10.42.42.6(pid=12305): Launched 11:13:12.322948 run osmo-stp_10.42.42.5(pid=12302): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12302)] 11:13:12.461889 run osmo-stp_10.42.42.5(pid=12302): stdout: | (launched: 2022-12-14_11:13:11.047517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:12.600827 run osmo-stp_10.42.42.5(pid=12302): stderr: | 20221214111311237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111311237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111311238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111311238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111311239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111311239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111311239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:12.737811 run osmo-stp_10.42.42.5(pid=12302): stdout: | (launched: 2022-12-14_11:13:11.047517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:12.868654 run osmo-stp_10.42.42.5(pid=12302): stderr: | 20221214111311237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111311237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111311238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111311238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111311239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111311239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111311239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:13.025950 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12302): Process ended prematurely: osmo-stp_10.42.42.5(pid=12302) [trial-2403↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12302)] [trial-2403↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 11:13:13.035292 tst handover.py:18: Test FAILED (6.7 sec) 11:13:13.063430 run osmo-hlr_10.42.42.2(pid=12299): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12299)] 11:13:13.114121 run osmo-hlr_10.42.42.2(pid=12299): stdout: | (launched: 2022-12-14_11:13:10.045699) 11:13:13.166300 run osmo-hlr_10.42.42.2(pid=12299): stderr: | 20221214111310241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111310241 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111310241 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111310241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111310241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111310241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111310253 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111310262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111310262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111310262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:13.239339 run osmo-msc_10.42.42.6(pid=12305): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12305)] 11:13:13.290979 run osmo-msc_10.42.42.6(pid=12305): stdout: | (launched: 2022-12-14_11:13:12.075352) 11:13:13.343282 run osmo-msc_10.42.42.6(pid=12305): stderr: | 20221214111312394 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111312394 DLGLOBAL DEBUG validating counter group 0x7f708adfac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111312394 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111312395 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111312395 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111312395 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111312397 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111312397 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111312397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111312397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:13.396078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12298): Terminating (SIGTERM) 11:13:13.438286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12301): Terminating (SIGTERM) 11:13:13.480786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12304): Terminating (SIGTERM) 11:13:13.523254 --- ParallelTerminationStrategy: PID 12298 died... 11:13:13.543631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12298): Terminated: ok {rc=0} 11:13:13.590333 --- ParallelTerminationStrategy: PID 12301 died... 11:13:13.610268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12301): Terminated: ok {rc=0} 11:13:13.656829 --- ParallelTerminationStrategy: PID 12304 died... 11:13:13.676559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12304): Terminated: ok {rc=0} 11:13:13.765955 bus /sierra_3: Setting Powered False 11:13:14.864417 bus /sierra_3: Setting Powered False 11:13:15.997743 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 11:13:17.272311 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:17.278636 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 11:13:17.328335 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 11:13:17.354556 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 11:13:17.407128 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 11:13:17.456389 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 11:13:17.482999 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 11:13:18.031038 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 11:13:18.036430 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:13:18.047384 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:13:18.080657 tst handover.py: using LAC 40537 11:13:18.211762 tst handover.py: using RAC 247 11:13:18.341509 tst handover.py: using CellId 40537 11:13:18.472872 tst handover.py: using BVCI 40538 11:13:18.594154 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:13:18.643765 tst handover.py: using LAC 40538 11:13:18.774487 tst handover.py: using RAC 248 11:13:18.904330 tst handover.py: using CellId 40538 11:13:19.033413 tst handover.py: using BVCI 40539 11:13:19.154528 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:13:19.166056 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:13:19.177302 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:13:19.188398 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:13:19.199640 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:13:19.210920 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:13:19.328398 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:13:19.445305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:19.895658 run create_hlr_db(pid=12310): Launched 11:13:20.013291 bus /sierra_2: Setting Powered False 11:13:21.075053 run create_hlr_db(pid=12310): Terminated: ok {rc=0} 11:13:21.498171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12312): Launched 11:13:21.828518 run osmo-hlr_10.42.42.2(pid=12313): Launched 11:13:21.953822 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:22.496271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12315): Launched 11:13:22.827633 run osmo-stp_10.42.42.5(pid=12316): Launched 11:13:22.954327 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:23.526831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12318): Launched 11:13:23.860197 run osmo-msc_10.42.42.6(pid=12319): Launched 11:13:24.044414 run osmo-stp_10.42.42.5(pid=12316): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12316)] 11:13:24.182971 run osmo-stp_10.42.42.5(pid=12316): stdout: | (launched: 2022-12-14_11:13:22.767066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:24.322103 run osmo-stp_10.42.42.5(pid=12316): stderr: | 20221214111322955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111322955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111322955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111322956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111322956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111322956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111322956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:24.460301 run osmo-stp_10.42.42.5(pid=12316): stdout: | (launched: 2022-12-14_11:13:22.767066) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:24.591699 run osmo-stp_10.42.42.5(pid=12316): stderr: | 20221214111322955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111322955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111322955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111322956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111322956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111322956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111322956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:24.748887 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12316): Process ended prematurely: osmo-stp_10.42.42.5(pid=12316) [trial-2403↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12316)] [trial-2403↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 11:13:24.758216 tst handover.py:18: Test FAILED (6.7 sec) 11:13:24.786242 run osmo-hlr_10.42.42.2(pid=12313): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12313)] 11:13:24.837190 run osmo-hlr_10.42.42.2(pid=12313): stdout: | (launched: 2022-12-14_11:13:21.767667) 11:13:24.889448 run osmo-hlr_10.42.42.2(pid=12313): stderr: | 20221214111321964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111321964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111321964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111321964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111321964 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111321964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111321976 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111321985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111321985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111321985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:24.962435 run osmo-msc_10.42.42.6(pid=12319): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12319)] 11:13:25.013147 run osmo-msc_10.42.42.6(pid=12319): stdout: | (launched: 2022-12-14_11:13:23.799133) 11:13:25.065243 run osmo-msc_10.42.42.6(pid=12319): stderr: | 20221214111324119 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111324119 DLGLOBAL DEBUG validating counter group 0x7fca1db4dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111324119 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111324119 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111324119 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111324119 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111324121 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111324122 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111324122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111324122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:25.117561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12312): Terminating (SIGTERM) 11:13:25.159770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12315): Terminating (SIGTERM) 11:13:25.202429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12318): Terminating (SIGTERM) 11:13:25.245090 --- ParallelTerminationStrategy: PID 12312 died... 11:13:25.265549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12312): Terminated: ok {rc=0} 11:13:25.312514 --- ParallelTerminationStrategy: PID 12315 died... 11:13:25.332927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12315): Terminated: ok {rc=0} 11:13:25.379492 --- ParallelTerminationStrategy: PID 12318 died... 11:13:25.399487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12318): Terminated: ok {rc=0} 11:13:25.487887 bus /sierra_3: Setting Powered False 11:13:26.587887 bus /sierra_3: Setting Powered False 11:13:27.704486 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:13:28.964643 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:28.970357 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:13:29.017260 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:13:29.044547 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:13:29.097486 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:13:29.143320 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:13:29.170370 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:13:29.724602 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:13:29.730647 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:13:29.742358 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:13:29.776089 tst handover.py: using LAC 40539 11:13:29.897975 tst handover.py: using RAC 249 11:13:30.019066 tst handover.py: using CellId 40539 11:13:30.139216 tst handover.py: using BVCI 40540 11:13:30.252517 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:13:30.296859 tst handover.py: using LAC 40540 11:13:30.419737 tst handover.py: using RAC 250 11:13:30.540091 tst handover.py: using CellId 40540 11:13:30.661378 tst handover.py: using BVCI 40541 11:13:30.773085 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:13:30.784057 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:13:30.795008 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:13:30.806056 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:13:30.817299 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:13:30.830176 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:13:30.971295 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:13:31.104021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:31.610578 run create_hlr_db(pid=12324): Launched 11:13:31.768373 bus /sierra_2: Setting Powered False 11:13:32.833815 run create_hlr_db(pid=12324): Terminated: ok {rc=0} 11:13:33.269495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12326): Launched 11:13:33.604400 run osmo-hlr_10.42.42.2(pid=12327): Launched 11:13:33.730991 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:34.278580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12329): Launched 11:13:34.610289 run osmo-stp_10.42.42.5(pid=12330): Launched 11:13:34.737378 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:35.306236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12332): Launched 11:13:35.639877 run osmo-msc_10.42.42.6(pid=12333): Launched 11:13:35.825256 run osmo-stp_10.42.42.5(pid=12330): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12330)] 11:13:35.963438 run osmo-stp_10.42.42.5(pid=12330): stdout: | (launched: 2022-12-14_11:13:34.549253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:36.103219 run osmo-stp_10.42.42.5(pid=12330): stderr: | 20221214111334740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111334740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111334740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111334741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111334741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111334741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111334741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:36.240392 run osmo-stp_10.42.42.5(pid=12330): stdout: | (launched: 2022-12-14_11:13:34.549253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:36.371640 run osmo-stp_10.42.42.5(pid=12330): stderr: | 20221214111334740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111334740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111334740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111334741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111334741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111334741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111334741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:36.529050 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12330): Process ended prematurely: osmo-stp_10.42.42.5(pid=12330) [trial-2403↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12330)] [trial-2403↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 11:13:36.538249 tst handover.py:18: Test FAILED (6.8 sec) 11:13:36.566311 run osmo-hlr_10.42.42.2(pid=12327): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12327)] 11:13:36.617094 run osmo-hlr_10.42.42.2(pid=12327): stdout: | (launched: 2022-12-14_11:13:33.542806) 11:13:36.669303 run osmo-hlr_10.42.42.2(pid=12327): stderr: | 20221214111333741 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111333741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111333741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111333741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111333742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111333742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111333753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111333761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111333762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111333762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:36.741829 run osmo-msc_10.42.42.6(pid=12333): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12333)] 11:13:36.792250 run osmo-msc_10.42.42.6(pid=12333): stdout: | (launched: 2022-12-14_11:13:35.578503) 11:13:36.845335 run osmo-msc_10.42.42.6(pid=12333): stderr: | 20221214111335898 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111335898 DLGLOBAL DEBUG validating counter group 0x7f1257e3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111335898 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111335898 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111335898 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111335898 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111335900 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111335901 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111335901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111335901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:36.898059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12326): Terminating (SIGTERM) 11:13:36.940312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12329): Terminating (SIGTERM) 11:13:36.982898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12332): Terminating (SIGTERM) 11:13:37.025841 --- ParallelTerminationStrategy: PID 12326 died... 11:13:37.045914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12326): Terminated: ok {rc=0} 11:13:37.092557 --- ParallelTerminationStrategy: PID 12329 died... 11:13:37.112505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12329): Terminated: ok {rc=0} 11:13:37.159057 --- ParallelTerminationStrategy: PID 12332 died... 11:13:37.178926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12332): Terminated: ok {rc=0} 11:13:37.267061 bus /sierra_3: Setting Powered False 11:13:38.367011 bus /sierra_3: Setting Powered False 11:13:39.486337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:13:40.736398 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:40.741764 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:13:40.791132 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:13:40.817580 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:13:40.871288 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:13:40.924879 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:13:40.951263 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:13:41.495804 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:13:41.501407 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:13:41.512367 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:13:41.546129 tst handover.py: using LAC 40541 11:13:41.669116 tst handover.py: using RAC 251 11:13:41.799148 tst handover.py: using CellId 40541 11:13:41.930353 tst handover.py: using BVCI 40542 11:13:42.051007 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:13:42.101523 tst handover.py: using LAC 40542 11:13:42.223993 tst handover.py: using RAC 252 11:13:42.350507 tst handover.py: using CellId 40542 11:13:42.470287 tst handover.py: using BVCI 40543 11:13:42.582664 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:13:42.593843 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:13:42.604811 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:13:42.615651 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:13:42.626822 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:13:42.637989 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:13:42.759281 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:13:42.878256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:43.330536 run create_hlr_db(pid=12339): Launched 11:13:43.450555 bus /sierra_2: Setting Powered False 11:13:44.511949 run create_hlr_db(pid=12339): Terminated: ok {rc=0} 11:13:44.916675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12341): Launched 11:13:45.225693 run osmo-hlr_10.42.42.2(pid=12342): Launched 11:13:45.343439 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:45.860920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12344): Launched 11:13:46.250735 run osmo-stp_10.42.42.5(pid=12345): Launched 11:13:46.483696 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:47.143115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12347): Launched 11:13:47.467362 run osmo-msc_10.42.42.6(pid=12348): Launched 11:13:47.642268 run osmo-stp_10.42.42.5(pid=12345): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12345)] 11:13:47.773476 run osmo-stp_10.42.42.5(pid=12345): stdout: | (launched: 2022-12-14_11:13:46.192898) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:47.904299 run osmo-stp_10.42.42.5(pid=12345): stderr: | 20221214111346499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111346499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111346500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111346500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111346500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111346501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111346501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:48.033193 run osmo-stp_10.42.42.5(pid=12345): stdout: | (launched: 2022-12-14_11:13:46.192898) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:48.156078 run osmo-stp_10.42.42.5(pid=12345): stderr: | 20221214111346499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111346499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111346500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111346500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111346500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111346501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111346501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:48.303378 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12345): Process ended prematurely: osmo-stp_10.42.42.5(pid=12345) [trial-2403↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12345)] [trial-2403↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 11:13:48.311987 tst handover.py:18: Test FAILED (6.8 sec) 11:13:48.338523 run osmo-hlr_10.42.42.2(pid=12342): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12342)] 11:13:48.387277 run osmo-hlr_10.42.42.2(pid=12342): stdout: | (launched: 2022-12-14_11:13:45.168365) 11:13:48.437566 run osmo-hlr_10.42.42.2(pid=12342): stderr: | 20221214111345341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111345341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111345342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111345342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111345342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111345342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111345354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111345362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111345362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111345362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:48.507507 run osmo-msc_10.42.42.6(pid=12348): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12348)] 11:13:48.555719 run osmo-msc_10.42.42.6(pid=12348): stdout: | (launched: 2022-12-14_11:13:47.409826) 11:13:48.606002 run osmo-msc_10.42.42.6(pid=12348): stderr: | 20221214111347680 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111347680 DLGLOBAL DEBUG validating counter group 0x7fd408a81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111347680 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111347680 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111347680 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111347681 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111347682 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111347683 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111347683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111347683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:13:48.656485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12341): Terminating (SIGTERM) 11:13:48.696686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12344): Terminating (SIGTERM) 11:13:48.736860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12347): Terminating (SIGTERM) 11:13:48.777538 --- ParallelTerminationStrategy: PID 12341 died... 11:13:48.797397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12341): Terminated: ok {rc=0} 11:13:48.842135 --- ParallelTerminationStrategy: PID 12344 died... 11:13:48.861121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12344): Terminated: ok {rc=0} 11:13:48.905509 --- ParallelTerminationStrategy: PID 12347 died... 11:13:48.924709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12347): Terminated: ok {rc=0} 11:13:49.011871 bus /sierra_3: Setting Powered False 11:13:50.112502 bus /sierra_3: Setting Powered False 11:13:51.229294 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 11:13:52.490503 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:13:52.496023 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:13:52.533038 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:13:52.559707 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:13:52.612293 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:13:52.650371 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:13:52.677499 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:13:53.224269 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 11:13:53.230251 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:53.241511 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 11:13:53.275185 tst handover.py: using LAC 40543 11:13:53.396142 tst handover.py: using RAC 253 11:13:53.517358 tst handover.py: using CellId 40543 11:13:53.638443 tst handover.py: using BVCI 40544 11:13:53.751249 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 11:13:53.785861 tst handover.py: using LAC 40544 11:13:53.906138 tst handover.py: using RAC 254 11:13:54.028172 tst handover.py: using CellId 40544 11:13:54.149378 tst handover.py: using BVCI 40545 11:13:54.260775 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:54.271622 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:54.282280 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:54.292787 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:54.303702 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:13:54.314667 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 11:13:54.436387 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 11:13:54.555916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:13:55.039916 run create_hlr_db(pid=12353): Launched 11:13:55.174481 bus /sierra_2: Setting Powered False 11:13:56.239469 run create_hlr_db(pid=12353): Terminated: ok {rc=0} 11:13:56.655621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12355): Launched 11:13:56.966239 run osmo-hlr_10.42.42.2(pid=12356): Launched 11:13:57.083501 run osmo-stp_10.42.42.5: Starting osmo-stp 11:13:57.585629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12358): Launched 11:13:57.895442 run osmo-stp_10.42.42.5(pid=12359): Launched 11:13:58.014157 run osmo-msc_10.42.42.6: Starting osmo-msc 11:13:58.543747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12361): Launched 11:13:58.855893 run osmo-msc_10.42.42.6(pid=12362): Launched 11:13:59.029717 run osmo-stp_10.42.42.5(pid=12359): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12359)] 11:13:59.159925 run osmo-stp_10.42.42.5(pid=12359): stdout: | (launched: 2022-12-14_11:13:57.838192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:59.290338 run osmo-stp_10.42.42.5(pid=12359): stderr: | 20221214111358006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111358006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111358006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111358008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111358008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111358008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111358009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:59.418586 run osmo-stp_10.42.42.5(pid=12359): stdout: | (launched: 2022-12-14_11:13:57.838192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:13:59.541242 run osmo-stp_10.42.42.5(pid=12359): stderr: | 20221214111358006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111358006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111358006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111358008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111358008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111358008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111358009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:13:59.688061 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12359): Process ended prematurely: osmo-stp_10.42.42.5(pid=12359) [trial-2403↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12359)] [trial-2403↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 11:13:59.696694 tst handover.py:18: Test FAILED (6.5 sec) 11:13:59.723357 run osmo-hlr_10.42.42.2(pid=12356): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12356)] 11:13:59.772005 run osmo-hlr_10.42.42.2(pid=12356): stdout: | (launched: 2022-12-14_11:13:56.908835) 11:13:59.822306 run osmo-hlr_10.42.42.2(pid=12356): stderr: | 20221214111357084 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111357084 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111357084 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111357084 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111357084 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111357084 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111357106 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111357114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111357115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111357115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:13:59.892478 run osmo-msc_10.42.42.6(pid=12362): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12362)] 11:13:59.940314 run osmo-msc_10.42.42.6(pid=12362): stdout: | (launched: 2022-12-14_11:13:58.798351) 11:13:59.990295 run osmo-msc_10.42.42.6(pid=12362): stderr: | 20221214111359068 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111359068 DLGLOBAL DEBUG validating counter group 0x7fe164f7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111359068 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111359068 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111359068 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111359069 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111359070 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111359071 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111359071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111359071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:00.040730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12355): Terminating (SIGTERM) 11:14:00.081136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12358): Terminating (SIGTERM) 11:14:00.121932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12361): Terminating (SIGTERM) 11:14:00.162853 --- ParallelTerminationStrategy: PID 12355 died... 11:14:00.182725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12355): Terminated: ok {rc=0} 11:14:00.227250 --- ParallelTerminationStrategy: PID 12358 died... 11:14:00.246995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12358): Terminated: ok {rc=0} 11:14:00.291289 --- ParallelTerminationStrategy: PID 12361 died... 11:14:00.310400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12361): Terminated: ok {rc=0} 11:14:00.397006 bus /sierra_3: Setting Powered False 11:14:01.503355 bus /sierra_3: Setting Powered False 11:14:02.629078 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 11:14:03.868329 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:14:03.873652 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:14:03.923126 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:14:03.949574 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:14:04.000849 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:14:04.049630 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:14:04.075899 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:14:04.630929 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 11:14:04.636746 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:04.648230 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:14:04.685966 tst handover.py: using LAC 40545 11:14:04.814385 tst handover.py: using RAC 255 11:14:04.941841 tst handover.py: using CellId 40545 11:14:05.072035 tst handover.py: using BVCI 40546 11:14:05.185997 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:14:05.232526 tst handover.py: using LAC 40546 11:14:05.351558 tst handover.py: using RAC 1 11:14:05.470370 tst handover.py: using CellId 40546 11:14:05.591218 tst handover.py: using BVCI 40547 11:14:05.703872 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:05.714697 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:05.725481 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:05.735988 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:05.747074 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:14:05.758011 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:14:05.873655 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:14:05.990096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:06.439850 run create_hlr_db(pid=12367): Launched 11:14:06.557428 bus /sierra_2: Setting Powered False 11:14:07.619189 run create_hlr_db(pid=12367): Terminated: ok {rc=0} 11:14:08.041603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12369): Launched 11:14:08.373463 run osmo-hlr_10.42.42.2(pid=12370): Launched 11:14:08.498090 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:09.035738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12372): Launched 11:14:09.365651 run osmo-stp_10.42.42.5(pid=12373): Launched 11:14:09.489854 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:10.055218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12375): Launched 11:14:10.385484 run osmo-msc_10.42.42.6(pid=12376): Launched 11:14:10.571001 run osmo-stp_10.42.42.5(pid=12373): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12373)] 11:14:10.710274 run osmo-stp_10.42.42.5(pid=12373): stdout: | (launched: 2022-12-14_11:14:09.304685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:10.849583 run osmo-stp_10.42.42.5(pid=12373): stderr: | 20221214111409494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111409494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111409495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111409495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111409495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111409496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111409496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:10.986404 run osmo-stp_10.42.42.5(pid=12373): stdout: | (launched: 2022-12-14_11:14:09.304685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:11.117941 run osmo-stp_10.42.42.5(pid=12373): stderr: | 20221214111409494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111409494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111409495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111409495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111409495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111409496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111409496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:11.274223 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12373): Process ended prematurely: osmo-stp_10.42.42.5(pid=12373) [trial-2403↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12373)] [trial-2403↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 11:14:11.283278 tst handover.py:18: Test FAILED (6.6 sec) 11:14:11.311093 run osmo-hlr_10.42.42.2(pid=12370): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12370)] 11:14:11.361286 run osmo-hlr_10.42.42.2(pid=12370): stdout: | (launched: 2022-12-14_11:14:08.312291) 11:14:11.413528 run osmo-hlr_10.42.42.2(pid=12370): stderr: | 20221214111408508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111408508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111408508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111408508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111408508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111408508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111408541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111408549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111408550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111408550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:11.486199 run osmo-msc_10.42.42.6(pid=12376): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12376)] 11:14:11.536574 run osmo-msc_10.42.42.6(pid=12376): stdout: | (launched: 2022-12-14_11:14:10.324365) 11:14:11.588815 run osmo-msc_10.42.42.6(pid=12376): stderr: | 20221214111410644 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111410644 DLGLOBAL DEBUG validating counter group 0x7f6137758c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111410644 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111410644 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111410644 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111410644 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111410646 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111410646 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111410647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111410647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:11.641455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12369): Terminating (SIGTERM) 11:14:11.683258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12372): Terminating (SIGTERM) 11:14:11.725731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12375): Terminating (SIGTERM) 11:14:11.767830 --- ParallelTerminationStrategy: PID 12369 died... 11:14:11.787853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12369): Terminated: ok {rc=0} 11:14:11.834263 --- ParallelTerminationStrategy: PID 12372 died... 11:14:11.853902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12372): Terminated: ok {rc=0} 11:14:11.900347 --- ParallelTerminationStrategy: PID 12375 died... 11:14:11.920506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12375): Terminated: ok {rc=0} 11:14:12.008596 bus /sierra_3: Setting Powered False 11:14:13.110423 bus /sierra_3: Setting Powered False 11:14:14.229952 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 11:14:15.487747 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:14:15.493123 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:14:15.541639 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:14:15.568209 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:14:15.619768 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:14:15.668052 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:14:15.694425 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:14:16.249380 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 11:14:16.257108 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:16.270866 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:14:16.308106 tst handover.py: using LAC 40547 11:14:16.445885 tst handover.py: using RAC 2 11:14:16.578531 tst handover.py: using CellId 40547 11:14:16.754959 tst handover.py: using BVCI 40548 11:14:16.902893 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:14:16.960534 tst handover.py: using LAC 40548 11:14:17.094117 tst handover.py: using RAC 3 11:14:17.226302 tst handover.py: using CellId 40548 11:14:17.359021 tst handover.py: using BVCI 40549 11:14:17.480284 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:17.494324 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:17.505749 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:17.517312 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:17.529518 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:14:17.541307 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:14:17.663694 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:14:17.785843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:18.240052 run create_hlr_db(pid=12381): Launched 11:14:18.359384 bus /sierra_2: Setting Powered False 11:14:19.421735 run create_hlr_db(pid=12381): Terminated: ok {rc=0} 11:14:19.846542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12383): Launched 11:14:20.179303 run osmo-hlr_10.42.42.2(pid=12384): Launched 11:14:20.306910 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:20.847420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12386): Launched 11:14:21.178005 run osmo-stp_10.42.42.5(pid=12387): Launched 11:14:21.305408 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:21.872649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12389): Launched 11:14:22.204768 run osmo-msc_10.42.42.6(pid=12390): Launched 11:14:22.390178 run osmo-stp_10.42.42.5(pid=12387): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12387)] 11:14:22.528313 run osmo-stp_10.42.42.5(pid=12387): stdout: | (launched: 2022-12-14_11:14:21.116532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:22.667685 run osmo-stp_10.42.42.5(pid=12387): stderr: | 20221214111421307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111421307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111421307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111421308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111421308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111421308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111421308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:22.805171 run osmo-stp_10.42.42.5(pid=12387): stdout: | (launched: 2022-12-14_11:14:21.116532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:22.936212 run osmo-stp_10.42.42.5(pid=12387): stderr: | 20221214111421307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111421307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111421307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111421308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111421308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111421308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111421308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:23.093369 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12387): Process ended prematurely: osmo-stp_10.42.42.5(pid=12387) [trial-2403↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12387)] [trial-2403↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 11:14:23.102626 tst handover.py:18: Test FAILED (6.8 sec) 11:14:23.130654 run osmo-hlr_10.42.42.2(pid=12384): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12384)] 11:14:23.181057 run osmo-hlr_10.42.42.2(pid=12384): stdout: | (launched: 2022-12-14_11:14:20.118376) 11:14:23.233152 run osmo-hlr_10.42.42.2(pid=12384): stderr: | 20221214111420314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111420314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111420314 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111420314 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111420314 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111420314 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111420329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111420339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111420339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111420339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:23.305858 run osmo-msc_10.42.42.6(pid=12390): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12390)] 11:14:23.356088 run osmo-msc_10.42.42.6(pid=12390): stdout: | (launched: 2022-12-14_11:14:22.143563) 11:14:23.408047 run osmo-msc_10.42.42.6(pid=12390): stderr: | 20221214111422463 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111422463 DLGLOBAL DEBUG validating counter group 0x7faca5422c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111422464 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111422464 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111422464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111422464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111422466 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111422466 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111422466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111422466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:23.460367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12383): Terminating (SIGTERM) 11:14:23.502319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12386): Terminating (SIGTERM) 11:14:23.544084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12389): Terminating (SIGTERM) 11:14:23.586089 --- ParallelTerminationStrategy: PID 12383 died... 11:14:23.606321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12383): Terminated: ok {rc=0} 11:14:23.652697 --- ParallelTerminationStrategy: PID 12386 died... 11:14:23.672415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12386): Terminated: ok {rc=0} 11:14:23.718461 --- ParallelTerminationStrategy: PID 12389 died... 11:14:23.738244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12389): Terminated: ok {rc=0} 11:14:23.826682 bus /sierra_3: Setting Powered False 11:14:24.926444 bus /sierra_3: Setting Powered False 11:14:26.045504 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:14:27.295689 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:14:27.301156 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:14:27.360350 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:14:27.386897 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:14:27.439515 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:14:27.498689 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:14:27.524881 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:14:28.074915 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:14:28.080568 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:14:28.091751 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:14:28.145968 tst handover.py: using LAC 40549 11:14:28.276335 tst handover.py: using RAC 4 11:14:28.403920 tst handover.py: using CellId 40549 11:14:28.531288 tst handover.py: using BVCI 40550 11:14:28.650980 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:14:28.699830 tst handover.py: using LAC 40550 11:14:28.821644 tst handover.py: using RAC 5 11:14:28.954983 tst handover.py: using CellId 40550 11:14:29.084839 tst handover.py: using BVCI 40551 11:14:29.205531 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:14:29.216933 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:14:29.228414 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:14:29.239837 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:14:29.251711 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:14:29.263540 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:14:29.383989 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:14:29.501104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:29.951767 run create_hlr_db(pid=12395): Launched 11:14:30.071961 bus /sierra_2: Setting Powered False 11:14:31.166637 run create_hlr_db(pid=12395): Terminated: ok {rc=0} 11:14:31.669389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12397): Launched 11:14:32.003616 run osmo-hlr_10.42.42.2(pid=12398): Launched 11:14:32.246750 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:32.770471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12400): Launched 11:14:33.082654 run osmo-stp_10.42.42.5(pid=12401): Launched 11:14:33.202164 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:33.733087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12403): Launched 11:14:34.042598 run osmo-msc_10.42.42.6(pid=12404): Launched 11:14:34.216767 run osmo-stp_10.42.42.5(pid=12401): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12401)] 11:14:34.348057 run osmo-stp_10.42.42.5(pid=12401): stdout: | (launched: 2022-12-14_11:14:33.025176) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:34.478867 run osmo-stp_10.42.42.5(pid=12401): stderr: | 20221214111433193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111433193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111433193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111433194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111433194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111433194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111433195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:34.607866 run osmo-stp_10.42.42.5(pid=12401): stdout: | (launched: 2022-12-14_11:14:33.025176) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:34.730577 run osmo-stp_10.42.42.5(pid=12401): stderr: | 20221214111433193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111433193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111433193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111433194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111433194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111433194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111433195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:34.878131 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12401): Process ended prematurely: osmo-stp_10.42.42.5(pid=12401) [trial-2403↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12401)] [trial-2403↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 11:14:34.886961 tst handover.py:18: Test FAILED (6.8 sec) 11:14:34.913884 run osmo-hlr_10.42.42.2(pid=12398): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12398)] 11:14:34.962551 run osmo-hlr_10.42.42.2(pid=12398): stdout: | (launched: 2022-12-14_11:14:31.944758) 11:14:35.012475 run osmo-hlr_10.42.42.2(pid=12398): stderr: | 20221214111432236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111432236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111432236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111432236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111432236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111432236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111432263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111432271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111432271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111432271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:35.082823 run osmo-msc_10.42.42.6(pid=12404): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12404)] 11:14:35.130649 run osmo-msc_10.42.42.6(pid=12404): stdout: | (launched: 2022-12-14_11:14:33.984779) 11:14:35.180611 run osmo-msc_10.42.42.6(pid=12404): stderr: | 20221214111434254 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111434254 DLGLOBAL DEBUG validating counter group 0x7f9c83f3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111434255 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111434255 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111434255 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111434255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111434257 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111434257 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111434257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111434257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:35.230861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12397): Terminating (SIGTERM) 11:14:35.271151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12400): Terminating (SIGTERM) 11:14:35.311760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12403): Terminating (SIGTERM) 11:14:35.353062 --- ParallelTerminationStrategy: PID 12397 died... 11:14:35.372805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12397): Terminated: ok {rc=0} 11:14:35.417785 --- ParallelTerminationStrategy: PID 12400 died... 11:14:35.436861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12400): Terminated: ok {rc=0} 11:14:35.481316 --- ParallelTerminationStrategy: PID 12403 died... 11:14:35.500406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12403): Terminated: ok {rc=0} 11:14:35.587718 bus /sierra_3: Setting Powered False 11:14:36.685977 bus /sierra_3: Setting Powered False 11:14:37.800736 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:14:39.067032 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:14:39.072230 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:14:39.136411 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:14:39.162808 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:14:39.217553 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:14:39.283353 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:14:39.310787 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:14:39.858718 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:14:39.865302 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:14:39.876421 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:14:39.924089 tst handover.py: using LAC 40551 11:14:40.039270 tst handover.py: using RAC 6 11:14:40.154344 tst handover.py: using CellId 40551 11:14:40.272138 tst handover.py: using BVCI 40552 11:14:40.379575 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:14:40.426675 tst handover.py: using LAC 40552 11:14:40.544655 tst handover.py: using RAC 7 11:14:40.659794 tst handover.py: using CellId 40552 11:14:40.775030 tst handover.py: using BVCI 40553 11:14:40.882737 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:14:40.893988 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:14:40.905262 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:14:40.916094 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:14:40.927312 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:14:40.938720 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:14:41.057370 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:14:41.178387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:41.644118 run create_hlr_db(pid=12409): Launched 11:14:41.776847 bus /sierra_2: Setting Powered False 11:14:42.841187 run create_hlr_db(pid=12409): Terminated: ok {rc=0} 11:14:43.267411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12411): Launched 11:14:43.591094 run osmo-hlr_10.42.42.2(pid=12412): Launched 11:14:43.714623 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:44.247694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12414): Launched 11:14:44.573595 run osmo-stp_10.42.42.5(pid=12415): Launched 11:14:44.698317 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:45.257689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12417): Launched 11:14:45.583628 run osmo-msc_10.42.42.6(pid=12418): Launched 11:14:45.765575 run osmo-stp_10.42.42.5(pid=12415): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12415)] 11:14:46.037208 run osmo-stp_10.42.42.5(pid=12415): stdout: | (launched: 2022-12-14_11:14:44.513839) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:46.264443 run osmo-stp_10.42.42.5(pid=12415): stderr: | 20221214111444702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111444702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111444703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111444703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111444704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111444704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111444704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:46.404639 run osmo-stp_10.42.42.5(pid=12415): stdout: | (launched: 2022-12-14_11:14:44.513839) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:46.537841 run osmo-stp_10.42.42.5(pid=12415): stderr: | 20221214111444702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111444702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111444703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111444703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111444704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111444704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111444704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:46.696942 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12415): Process ended prematurely: osmo-stp_10.42.42.5(pid=12415) [trial-2403↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12415)] [trial-2403↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 11:14:46.707138 tst handover.py:18: Test FAILED (6.8 sec) 11:14:46.736003 run osmo-hlr_10.42.42.2(pid=12412): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12412)] 11:14:46.787269 run osmo-hlr_10.42.42.2(pid=12412): stdout: | (launched: 2022-12-14_11:14:43.531492) 11:14:46.840049 run osmo-hlr_10.42.42.2(pid=12412): stderr: | 20221214111443725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111443725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111443725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111443725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111443725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111443725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111443737 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111443746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111443746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111443746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:46.913427 run osmo-msc_10.42.42.6(pid=12418): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12418)] 11:14:46.964546 run osmo-msc_10.42.42.6(pid=12418): stdout: | (launched: 2022-12-14_11:14:45.523455) 11:14:47.018125 run osmo-msc_10.42.42.6(pid=12418): stderr: | 20221214111445867 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111445867 DLGLOBAL DEBUG validating counter group 0x7f728b9e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111445867 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111445867 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111445868 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111445868 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111445870 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111445870 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111445870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111445870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:47.071875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12411): Terminating (SIGTERM) 11:14:47.114790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12414): Terminating (SIGTERM) 11:14:47.157412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12417): Terminating (SIGTERM) 11:14:47.200020 --- ParallelTerminationStrategy: PID 12411 died... 11:14:47.220352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12411): Terminated: ok {rc=0} 11:14:47.267289 --- ParallelTerminationStrategy: PID 12414 died... 11:14:47.287552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12414): Terminated: ok {rc=0} 11:14:47.337797 --- ParallelTerminationStrategy: PID 12417 died... 11:14:47.357355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12417): Terminated: ok {rc=0} 11:14:47.444307 bus /sierra_3: Setting Powered False 11:14:48.541812 bus /sierra_3: Setting Powered False 11:14:49.656452 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 11:14:50.927845 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:14:50.933172 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:14:50.983873 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:14:51.010163 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:14:51.062152 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:14:51.112882 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:14:51.139888 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:14:51.691025 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 11:14:51.696366 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:14:51.707572 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 11:14:51.755510 tst handover.py: using LAC 40553 11:14:51.881670 tst handover.py: using RAC 8 11:14:52.007837 tst handover.py: using CellId 40553 11:14:52.136102 tst handover.py: using BVCI 40554 11:14:52.252728 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 11:14:52.288829 tst handover.py: using LAC 40554 11:14:52.415002 tst handover.py: using RAC 9 11:14:52.542414 tst handover.py: using CellId 40554 11:14:52.669392 tst handover.py: using BVCI 40555 11:14:52.785778 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:14:52.796847 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:14:52.807907 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:14:52.818997 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:14:52.830128 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:14:52.841270 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 11:14:52.957338 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 11:14:53.076623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:14:53.547934 run create_hlr_db(pid=12423): Launched 11:14:53.678705 bus /sierra_2: Setting Powered False 11:14:54.742837 run create_hlr_db(pid=12423): Terminated: ok {rc=0} 11:14:55.166995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12425): Launched 11:14:55.490979 run osmo-hlr_10.42.42.2(pid=12426): Launched 11:14:55.614742 run osmo-stp_10.42.42.5: Starting osmo-stp 11:14:56.142436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12428): Launched 11:14:56.465995 run osmo-stp_10.42.42.5(pid=12429): Launched 11:14:56.589401 run osmo-msc_10.42.42.6: Starting osmo-msc 11:14:57.150601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12431): Launched 11:14:57.478651 run osmo-msc_10.42.42.6(pid=12432): Launched 11:14:57.661196 run osmo-stp_10.42.42.5(pid=12429): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12429)] 11:14:57.799267 run osmo-stp_10.42.42.5(pid=12429): stdout: | (launched: 2022-12-14_11:14:56.405926) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:57.937507 run osmo-stp_10.42.42.5(pid=12429): stderr: | 20221214111456593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111456593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111456594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111456594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111456594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111456595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111456595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:58.073244 run osmo-stp_10.42.42.5(pid=12429): stdout: | (launched: 2022-12-14_11:14:56.405926) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:14:58.202374 run osmo-stp_10.42.42.5(pid=12429): stderr: | 20221214111456593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111456593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111456594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111456594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111456594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111456595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111456595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:14:58.357119 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12429): Process ended prematurely: osmo-stp_10.42.42.5(pid=12429) [trial-2403↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12429)] [trial-2403↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 11:14:58.366077 tst handover.py:18: Test FAILED (6.7 sec) 11:14:58.393597 run osmo-hlr_10.42.42.2(pid=12426): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12426)] 11:14:58.444180 run osmo-hlr_10.42.42.2(pid=12426): stdout: | (launched: 2022-12-14_11:14:55.431085) 11:14:58.496050 run osmo-hlr_10.42.42.2(pid=12426): stderr: | 20221214111455625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111455625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111455625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111455625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111455625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111455625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111455637 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111455645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111455645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111455646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:14:58.568661 run osmo-msc_10.42.42.6(pid=12432): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12432)] 11:14:58.618731 run osmo-msc_10.42.42.6(pid=12432): stdout: | (launched: 2022-12-14_11:14:57.417921) 11:14:58.671106 run osmo-msc_10.42.42.6(pid=12432): stderr: | 20221214111457736 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111457737 DLGLOBAL DEBUG validating counter group 0x7f41e9a0ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111457737 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111457737 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111457737 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111457737 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111457739 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111457739 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111457739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111457739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:14:58.723250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12425): Terminating (SIGTERM) 11:14:58.765033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12428): Terminating (SIGTERM) 11:14:58.806794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12431): Terminating (SIGTERM) 11:14:58.848814 --- ParallelTerminationStrategy: PID 12425 died... 11:14:58.869093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12425): Terminated: ok {rc=0} 11:14:58.915476 --- ParallelTerminationStrategy: PID 12428 died... 11:14:58.935064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12428): Terminated: ok {rc=0} 11:14:58.981200 --- ParallelTerminationStrategy: PID 12431 died... 11:14:59.000649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12431): Terminated: ok {rc=0} 11:14:59.088895 bus /sierra_3: Setting Powered False 11:15:00.187343 bus /sierra_3: Setting Powered False 11:15:01.323326 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 11:15:02.593325 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:15:02.599049 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:15:02.663034 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:15:02.690349 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:15:02.745763 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:15:02.811283 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:15:02.838663 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:15:03.386826 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 11:15:03.392278 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:15:03.403609 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:15:03.451987 tst handover.py: using LAC 40555 11:15:03.574446 tst handover.py: using RAC 10 11:15:03.695622 tst handover.py: using CellId 40555 11:15:03.817041 tst handover.py: using BVCI 40556 11:15:03.927371 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:15:03.975642 tst handover.py: using LAC 40556 11:15:04.104691 tst handover.py: using RAC 11 11:15:04.231638 tst handover.py: using CellId 40556 11:15:04.358384 tst handover.py: using BVCI 40557 11:15:04.476222 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:15:04.487907 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:15:04.499246 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:15:04.510433 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:15:04.521696 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:15:04.533085 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:15:04.649573 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:15:04.769730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:15:05.249114 run create_hlr_db(pid=12441): Launched 11:15:05.383462 bus /sierra_2: Setting Powered False 11:15:06.449178 run create_hlr_db(pid=12441): Terminated: ok {rc=0} 11:15:06.864309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12443): Launched 11:15:07.173215 run osmo-hlr_10.42.42.2(pid=12444): Launched 11:15:07.290748 run osmo-stp_10.42.42.5: Starting osmo-stp 11:15:07.809706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12446): Launched 11:15:08.119064 run osmo-stp_10.42.42.5(pid=12447): Launched 11:15:08.236189 run osmo-msc_10.42.42.6: Starting osmo-msc 11:15:08.778603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12449): Launched 11:15:09.087516 run osmo-msc_10.42.42.6(pid=12450): Launched 11:15:09.260241 run osmo-stp_10.42.42.5(pid=12447): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12447)] 11:15:09.391526 run osmo-stp_10.42.42.5(pid=12447): stdout: | (launched: 2022-12-14_11:15:08.061830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:09.520677 run osmo-stp_10.42.42.5(pid=12447): stderr: | 20221214111508233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111508233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111508233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111508234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111508234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111508234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111508234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:09.648516 run osmo-stp_10.42.42.5(pid=12447): stdout: | (launched: 2022-12-14_11:15:08.061830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:09.769915 run osmo-stp_10.42.42.5(pid=12447): stderr: | 20221214111508233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111508233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111508233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111508234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111508234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111508234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111508234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:09.915423 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12447): Process ended prematurely: osmo-stp_10.42.42.5(pid=12447) [trial-2403↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12447)] [trial-2403↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 11:15:09.923852 tst handover.py:18: Test FAILED (6.5 sec) 11:15:09.950115 run osmo-hlr_10.42.42.2(pid=12444): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12444)] 11:15:09.998286 run osmo-hlr_10.42.42.2(pid=12444): stdout: | (launched: 2022-12-14_11:15:07.115510) 11:15:10.048016 run osmo-hlr_10.42.42.2(pid=12444): stderr: | 20221214111507291 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111507291 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111507291 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111507291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111507291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111507291 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111507303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111507313 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111507313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111507314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:15:10.117874 run osmo-msc_10.42.42.6(pid=12450): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12450)] 11:15:10.165370 run osmo-msc_10.42.42.6(pid=12450): stdout: | (launched: 2022-12-14_11:15:09.030584) 11:15:10.214981 run osmo-msc_10.42.42.6(pid=12450): stderr: | 20221214111509301 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111509301 DLGLOBAL DEBUG validating counter group 0x7f87df1e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111509301 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111509301 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111509301 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111509301 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111509303 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111509303 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111509304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111509304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:15:10.264914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12443): Terminating (SIGTERM) 11:15:10.305210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12446): Terminating (SIGTERM) 11:15:10.345321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12449): Terminating (SIGTERM) 11:15:10.385641 --- ParallelTerminationStrategy: PID 12443 died... 11:15:10.405236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12443): Terminated: ok {rc=0} 11:15:10.449506 --- ParallelTerminationStrategy: PID 12446 died... 11:15:10.468602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12446): Terminated: ok {rc=0} 11:15:10.512920 --- ParallelTerminationStrategy: PID 12449 died... 11:15:10.532358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12449): Terminated: ok {rc=0} 11:15:10.619599 bus /sierra_3: Setting Powered False 11:15:11.720119 bus /sierra_3: Setting Powered False 11:15:12.837002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 11:15:14.111582 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:15:14.118078 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:15:14.180572 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:15:14.207228 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:15:14.259928 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:15:14.322411 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:15:14.348987 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:15:14.901893 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 11:15:14.907365 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:15:14.918640 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:15:14.967364 tst handover.py: using LAC 40557 11:15:15.095030 tst handover.py: using RAC 12 11:15:15.223911 tst handover.py: using CellId 40557 11:15:15.345143 tst handover.py: using BVCI 40558 11:15:15.456142 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:15:15.503181 tst handover.py: using LAC 40558 11:15:15.624699 tst handover.py: using RAC 13 11:15:15.744748 tst handover.py: using CellId 40558 11:15:15.879118 tst handover.py: using BVCI 40559 11:15:15.996458 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:15:16.008317 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:15:16.020028 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:15:16.031904 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:15:16.045011 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:15:16.057989 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:15:16.186326 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:15:16.309170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:15:16.798416 run create_hlr_db(pid=12456): Launched 11:15:16.967388 bus /sierra_2: Setting Powered False 11:15:18.031886 run create_hlr_db(pid=12456): Terminated: ok {rc=0} 11:15:18.443126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12458): Launched 11:15:18.749213 run osmo-hlr_10.42.42.2(pid=12459): Launched 11:15:18.865710 run osmo-stp_10.42.42.5: Starting osmo-stp 11:15:19.366332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12461): Launched 11:15:19.671902 run osmo-stp_10.42.42.5(pid=12462): Launched 11:15:19.788868 run osmo-msc_10.42.42.6: Starting osmo-msc 11:15:20.313777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12464): Launched 11:15:20.618538 run osmo-msc_10.42.42.6(pid=12465): Launched 11:15:20.788680 run osmo-stp_10.42.42.5(pid=12462): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12462)] 11:15:20.917669 run osmo-stp_10.42.42.5(pid=12462): stdout: | (launched: 2022-12-14_11:15:19.615980) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:21.046680 run osmo-stp_10.42.42.5(pid=12462): stderr: | 20221214111519784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111519784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111519785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111519785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111519785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111519786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111519786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:21.173350 run osmo-stp_10.42.42.5(pid=12462): stdout: | (launched: 2022-12-14_11:15:19.615980) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:21.295311 run osmo-stp_10.42.42.5(pid=12462): stderr: | 20221214111519784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111519784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111519785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111519785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111519785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111519786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111519786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:21.440056 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12462): Process ended prematurely: osmo-stp_10.42.42.5(pid=12462) [trial-2403↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12462)] [trial-2403↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 11:15:21.448455 tst handover.py:18: Test FAILED (6.5 sec) 11:15:21.474728 run osmo-hlr_10.42.42.2(pid=12459): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12459)] 11:15:21.523305 run osmo-hlr_10.42.42.2(pid=12459): stdout: | (launched: 2022-12-14_11:15:18.693089) 11:15:21.573451 run osmo-hlr_10.42.42.2(pid=12459): stderr: | 20221214111518868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111518868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111518868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111518868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111518868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111518868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111518880 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111518888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111518888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111518888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:15:21.642877 run osmo-msc_10.42.42.6(pid=12465): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12465)] 11:15:21.690098 run osmo-msc_10.42.42.6(pid=12465): stdout: | (launched: 2022-12-14_11:15:20.562252) 11:15:21.739095 run osmo-msc_10.42.42.6(pid=12465): stderr: | 20221214111520834 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111520834 DLGLOBAL DEBUG validating counter group 0x7f507e03ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111520834 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111520834 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111520834 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111520834 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111520836 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111520837 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111520837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111520837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:15:21.788684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12458): Terminating (SIGTERM) 11:15:21.828832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12461): Terminating (SIGTERM) 11:15:21.868369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12464): Terminating (SIGTERM) 11:15:21.908384 --- ParallelTerminationStrategy: PID 12458 died... 11:15:21.927815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12458): Terminated: ok {rc=0} 11:15:21.971646 --- ParallelTerminationStrategy: PID 12461 died... 11:15:21.990345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12461): Terminated: ok {rc=0} 11:15:22.034099 --- ParallelTerminationStrategy: PID 12464 died... 11:15:22.052811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12464): Terminated: ok {rc=0} 11:15:22.139035 bus /sierra_3: Setting Powered False 11:15:23.237405 bus /sierra_3: Setting Powered False 11:15:24.353025 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:15:25.620227 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:15:25.625544 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:15:25.685179 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:15:25.711405 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:15:25.762888 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:15:25.822160 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:15:25.848297 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:15:26.404207 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:15:26.409783 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:15:26.421220 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:15:26.467602 tst handover.py: using LAC 40559 11:15:26.586432 tst handover.py: using RAC 14 11:15:26.712638 tst handover.py: using CellId 40559 11:15:26.837631 tst handover.py: using BVCI 40560 11:15:26.954951 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:15:27.007622 tst handover.py: using LAC 40560 11:15:27.135109 tst handover.py: using RAC 15 11:15:27.267873 tst handover.py: using CellId 40560 11:15:27.403294 tst handover.py: using BVCI 40561 11:15:27.522625 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:15:27.534311 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:15:27.545820 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:15:27.557403 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:15:27.569252 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:15:27.580651 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:15:27.698735 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:15:27.814679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:15:28.259951 run create_hlr_db(pid=12470): Launched 11:15:28.377560 bus /sierra_2: Setting Powered False 11:15:29.438098 run create_hlr_db(pid=12470): Terminated: ok {rc=0} 11:15:29.838607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12472): Launched 11:15:30.145129 run osmo-hlr_10.42.42.2(pid=12473): Launched 11:15:30.262587 run osmo-stp_10.42.42.5: Starting osmo-stp 11:15:30.768432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12475): Launched 11:15:31.121713 run osmo-stp_10.42.42.5(pid=12476): Launched 11:15:31.361434 run osmo-msc_10.42.42.6: Starting osmo-msc 11:15:32.021703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12478): Launched 11:15:32.335040 run osmo-msc_10.42.42.6(pid=12479): Launched 11:15:32.507202 run osmo-stp_10.42.42.5(pid=12476): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12476)] 11:15:32.636929 run osmo-stp_10.42.42.5(pid=12476): stdout: | (launched: 2022-12-14_11:15:31.056880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:32.768007 run osmo-stp_10.42.42.5(pid=12476): stderr: | 20221214111531331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111531331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111531332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111531332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111531341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111531341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111531341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:32.896572 run osmo-stp_10.42.42.5(pid=12476): stdout: | (launched: 2022-12-14_11:15:31.056880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:33.018991 run osmo-stp_10.42.42.5(pid=12476): stderr: | 20221214111531331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111531331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111531332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111531332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111531341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111531341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111531341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:33.166089 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12476): Process ended prematurely: osmo-stp_10.42.42.5(pid=12476) [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12476)] [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 11:15:33.174470 tst handover.py:18: Test FAILED (6.8 sec) 11:15:33.200669 run osmo-hlr_10.42.42.2(pid=12473): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12473)] 11:15:33.249244 run osmo-hlr_10.42.42.2(pid=12473): stdout: | (launched: 2022-12-14_11:15:30.088703) 11:15:33.299177 run osmo-hlr_10.42.42.2(pid=12473): stderr: | 20221214111530261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111530261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111530261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111530261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111530261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111530261 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111530274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111530282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111530282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111530282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:15:33.369351 run osmo-msc_10.42.42.6(pid=12479): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12479)] 11:15:33.416937 run osmo-msc_10.42.42.6(pid=12479): stdout: | (launched: 2022-12-14_11:15:32.278194) 11:15:33.466399 run osmo-msc_10.42.42.6(pid=12479): stderr: | 20221214111532546 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111532546 DLGLOBAL DEBUG validating counter group 0x7f071e718c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111532547 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111532547 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111532547 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111532547 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111532549 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111532549 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111532549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111532549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:15:33.516432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12472): Terminating (SIGTERM) 11:15:33.556561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12475): Terminating (SIGTERM) 11:15:33.596794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12478): Terminating (SIGTERM) 11:15:33.637293 --- ParallelTerminationStrategy: PID 12472 died... 11:15:33.656688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12472): Terminated: ok {rc=0} 11:15:33.701326 --- ParallelTerminationStrategy: PID 12475 died... 11:15:33.720159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12475): Terminated: ok {rc=0} 11:15:33.764671 --- ParallelTerminationStrategy: PID 12478 died... 11:15:33.783563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12478): Terminated: ok {rc=0} 11:15:33.871081 bus /sierra_3: Setting Powered False 11:15:34.970987 bus /sierra_3: Setting Powered False 11:15:36.084041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 11:15:37.355737 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:15:37.360822 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:15:37.407922 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:15:37.434180 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:15:37.487773 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:15:37.535439 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:15:37.561719 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:15:38.114990 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 11:15:38.120465 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:15:38.132088 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 11:15:38.176194 tst handover.py: using LAC 40561 11:15:38.298528 tst handover.py: using RAC 16 11:15:38.420560 tst handover.py: using CellId 40561 11:15:38.540725 tst handover.py: using BVCI 40562 11:15:38.652124 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 11:15:38.686732 tst handover.py: using LAC 40562 11:15:38.808248 tst handover.py: using RAC 17 11:15:38.929629 tst handover.py: using CellId 40562 11:15:39.050943 tst handover.py: using BVCI 40563 11:15:39.161965 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:15:39.173084 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:15:39.184213 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:15:39.195214 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:15:39.206553 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:15:39.217759 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 11:15:39.338885 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 11:15:39.458076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:15:39.908389 run create_hlr_db(pid=12484): Launched 11:15:40.026469 bus /sierra_2: Setting Powered False 11:15:41.087877 run create_hlr_db(pid=12484): Terminated: ok {rc=0} 11:15:41.509377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12486): Launched 11:15:41.839107 run osmo-hlr_10.42.42.2(pid=12487): Launched 11:15:41.966227 run osmo-stp_10.42.42.5: Starting osmo-stp 11:15:42.506293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12489): Launched 11:15:42.834111 run osmo-stp_10.42.42.5(pid=12490): Launched 11:15:42.960432 run osmo-msc_10.42.42.6: Starting osmo-msc 11:15:43.524449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12492): Launched 11:15:43.853861 run osmo-msc_10.42.42.6(pid=12493): Launched 11:15:44.038066 run osmo-stp_10.42.42.5(pid=12490): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12490)] 11:15:44.176294 run osmo-stp_10.42.42.5(pid=12490): stdout: | (launched: 2022-12-14_11:15:42.773869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:44.314493 run osmo-stp_10.42.42.5(pid=12490): stderr: | 20221214111542961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111542962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111542962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111542962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111542963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111542963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111542963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:44.450855 run osmo-stp_10.42.42.5(pid=12490): stdout: | (launched: 2022-12-14_11:15:42.773869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:44.581039 run osmo-stp_10.42.42.5(pid=12490): stderr: | 20221214111542961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111542962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111542962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111542962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111542963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111542963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111542963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:44.736638 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12490): Process ended prematurely: osmo-stp_10.42.42.5(pid=12490) [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12490)] [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 11:15:44.745779 tst handover.py:18: Test FAILED (6.6 sec) 11:15:44.773576 run osmo-hlr_10.42.42.2(pid=12487): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12487)] 11:15:44.824199 run osmo-hlr_10.42.42.2(pid=12487): stdout: | (launched: 2022-12-14_11:15:41.778961) 11:15:44.876475 run osmo-hlr_10.42.42.2(pid=12487): stderr: | 20221214111541972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111541972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111541972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111541972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111541972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111541972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111541983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111541992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111541992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111541992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:15:44.949690 run osmo-msc_10.42.42.6(pid=12493): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12493)] 11:15:44.999993 run osmo-msc_10.42.42.6(pid=12493): stdout: | (launched: 2022-12-14_11:15:43.793680) 11:15:45.052100 run osmo-msc_10.42.42.6(pid=12493): stderr: | 20221214111544114 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111544114 DLGLOBAL DEBUG validating counter group 0x7f5b80bf0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111544114 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111544114 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111544114 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111544114 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111544116 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111544116 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111544117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111544117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:15:45.104827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12486): Terminating (SIGTERM) 11:15:45.146893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12489): Terminating (SIGTERM) 11:15:45.189499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12492): Terminating (SIGTERM) 11:15:45.231771 --- ParallelTerminationStrategy: PID 12486 died... 11:15:45.251953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12486): Terminated: ok {rc=0} 11:15:45.298557 --- ParallelTerminationStrategy: PID 12489 died... 11:15:45.318503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12489): Terminated: ok {rc=0} 11:15:45.365090 --- ParallelTerminationStrategy: PID 12492 died... 11:15:45.384758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12492): Terminated: ok {rc=0} 11:15:45.473363 bus /sierra_3: Setting Powered False 11:15:46.577894 bus /sierra_3: Setting Powered False 11:15:47.703843 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 11:15:48.960397 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:15:48.965578 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:15:49.025406 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:15:49.052005 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:15:49.103684 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:15:49.166062 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:15:49.193441 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:15:49.746824 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 11:15:49.752590 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:15:49.764275 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:15:49.809597 tst handover.py: using LAC 40563 11:15:49.935189 tst handover.py: using RAC 18 11:15:50.062592 tst handover.py: using CellId 40563 11:15:50.189162 tst handover.py: using BVCI 40564 11:15:50.307268 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:15:50.360539 tst handover.py: using LAC 40564 11:15:50.489413 tst handover.py: using RAC 19 11:15:50.618418 tst handover.py: using CellId 40564 11:15:50.746096 tst handover.py: using BVCI 40565 11:15:50.866544 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:15:50.878184 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:15:50.889718 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:15:50.901136 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:15:50.913028 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:15:50.924998 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:15:51.043829 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:15:51.163144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:15:51.643695 run create_hlr_db(pid=12498): Launched 11:15:51.779536 bus /sierra_2: Setting Powered False 11:15:52.844620 run create_hlr_db(pid=12498): Terminated: ok {rc=0} 11:15:53.275952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12500): Launched 11:15:53.607085 run osmo-hlr_10.42.42.2(pid=12501): Launched 11:15:53.733908 run osmo-stp_10.42.42.5: Starting osmo-stp 11:15:54.274621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12503): Launched 11:15:54.603402 run osmo-stp_10.42.42.5(pid=12504): Launched 11:15:54.730521 run osmo-msc_10.42.42.6: Starting osmo-msc 11:15:55.295522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12506): Launched 11:15:55.627535 run osmo-msc_10.42.42.6(pid=12507): Launched 11:15:55.811431 run osmo-stp_10.42.42.5(pid=12504): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12504)] 11:15:55.950385 run osmo-stp_10.42.42.5(pid=12504): stdout: | (launched: 2022-12-14_11:15:54.542984) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:56.089489 run osmo-stp_10.42.42.5(pid=12504): stderr: | 20221214111554733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111554733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111554733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111554734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111554734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111554734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111554734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:56.225891 run osmo-stp_10.42.42.5(pid=12504): stdout: | (launched: 2022-12-14_11:15:54.542984) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:15:56.355658 run osmo-stp_10.42.42.5(pid=12504): stderr: | 20221214111554733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111554733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111554733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111554734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111554734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111554734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111554734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:15:56.511523 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12504): Process ended prematurely: osmo-stp_10.42.42.5(pid=12504) [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12504)] [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 11:15:56.520476 tst handover.py:18: Test FAILED (6.8 sec) 11:15:56.548343 run osmo-hlr_10.42.42.2(pid=12501): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12501)] 11:15:56.598463 run osmo-hlr_10.42.42.2(pid=12501): stdout: | (launched: 2022-12-14_11:15:53.546512) 11:15:56.650394 run osmo-hlr_10.42.42.2(pid=12501): stderr: | 20221214111553741 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111553741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111553741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111553741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111553741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111553741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111553754 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111553763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111553763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111553763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:15:56.722703 run osmo-msc_10.42.42.6(pid=12507): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12507)] 11:15:56.773127 run osmo-msc_10.42.42.6(pid=12507): stdout: | (launched: 2022-12-14_11:15:55.566671) 11:15:56.824713 run osmo-msc_10.42.42.6(pid=12507): stderr: | 20221214111555886 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111555886 DLGLOBAL DEBUG validating counter group 0x7fc497dfac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111555886 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111555886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111555886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111555887 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111555888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111555889 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111555889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111555889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:15:56.876867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12500): Terminating (SIGTERM) 11:15:56.918790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12503): Terminating (SIGTERM) 11:15:56.960487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12506): Terminating (SIGTERM) 11:15:57.002528 --- ParallelTerminationStrategy: PID 12500 died... 11:15:57.022267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12500): Terminated: ok {rc=0} 11:15:57.068330 --- ParallelTerminationStrategy: PID 12503 died... 11:15:57.088237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12503): Terminated: ok {rc=0} 11:15:57.134710 --- ParallelTerminationStrategy: PID 12506 died... 11:15:57.154487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12506): Terminated: ok {rc=0} 11:15:57.243138 bus /sierra_3: Setting Powered False 11:15:58.342052 bus /sierra_3: Setting Powered False 11:15:59.459059 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 11:16:00.727162 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:16:00.732424 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:16:00.790518 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:16:00.816856 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:16:00.880231 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:16:00.963274 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:16:00.991057 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:16:01.546314 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 11:16:01.553883 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:16:01.566511 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:16:01.613767 tst handover.py: using LAC 40565 11:16:01.781496 tst handover.py: using RAC 20 11:16:01.911382 tst handover.py: using CellId 40565 11:16:02.045720 tst handover.py: using BVCI 40566 11:16:02.194455 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:16:02.252634 tst handover.py: using LAC 40566 11:16:02.379975 tst handover.py: using RAC 21 11:16:02.508435 tst handover.py: using CellId 40566 11:16:02.637524 tst handover.py: using BVCI 40567 11:16:02.758694 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:16:02.770382 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:16:02.781847 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:16:02.793405 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:16:02.805554 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:16:02.817635 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:16:02.938705 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:16:03.059235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:16:03.541082 run create_hlr_db(pid=12512): Launched 11:16:03.676282 bus /sierra_2: Setting Powered False 11:16:04.742063 run create_hlr_db(pid=12512): Terminated: ok {rc=0} 11:16:05.157876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12514): Launched 11:16:05.466688 run osmo-hlr_10.42.42.2(pid=12515): Launched 11:16:05.585796 run osmo-stp_10.42.42.5: Starting osmo-stp 11:16:06.101382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12517): Launched 11:16:06.409457 run osmo-stp_10.42.42.5(pid=12518): Launched 11:16:06.527979 run osmo-msc_10.42.42.6: Starting osmo-msc 11:16:07.058424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12520): Launched 11:16:07.365855 run osmo-msc_10.42.42.6(pid=12521): Launched 11:16:07.537411 run osmo-stp_10.42.42.5(pid=12518): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12518)] 11:16:07.668209 run osmo-stp_10.42.42.5(pid=12518): stdout: | (launched: 2022-12-14_11:16:06.352089) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:07.798238 run osmo-stp_10.42.42.5(pid=12518): stderr: | 20221214111606520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111606520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111606520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111606521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111606521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111606521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111606521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:07.926104 run osmo-stp_10.42.42.5(pid=12518): stdout: | (launched: 2022-12-14_11:16:06.352089) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:08.048271 run osmo-stp_10.42.42.5(pid=12518): stderr: | 20221214111606520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111606520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111606520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111606521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111606521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111606521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111606521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:08.194521 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12518): Process ended prematurely: osmo-stp_10.42.42.5(pid=12518) [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12518)] [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 11:16:08.202986 tst handover.py:18: Test FAILED (6.6 sec) 11:16:08.229280 run osmo-hlr_10.42.42.2(pid=12515): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12515)] 11:16:08.277998 run osmo-hlr_10.42.42.2(pid=12515): stdout: | (launched: 2022-12-14_11:16:05.409717) 11:16:08.327642 run osmo-hlr_10.42.42.2(pid=12515): stderr: | 20221214111605583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111605583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111605583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111605583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111605583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111605583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111605595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111605603 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111605603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111605603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:16:08.397577 run osmo-msc_10.42.42.6(pid=12521): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12521)] 11:16:08.445124 run osmo-msc_10.42.42.6(pid=12521): stdout: | (launched: 2022-12-14_11:16:07.308750) 11:16:08.495410 run osmo-msc_10.42.42.6(pid=12521): stderr: | 20221214111607578 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111607578 DLGLOBAL DEBUG validating counter group 0x7f6188c66c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111607578 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111607578 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111607578 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111607578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111607580 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111607581 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111607581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111607581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:16:08.545713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12514): Terminating (SIGTERM) 11:16:08.585700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12517): Terminating (SIGTERM) 11:16:08.625673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12520): Terminating (SIGTERM) 11:16:08.665905 --- ParallelTerminationStrategy: PID 12514 died... 11:16:08.685558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12514): Terminated: ok {rc=0} 11:16:08.730029 --- ParallelTerminationStrategy: PID 12517 died... 11:16:08.749296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12517): Terminated: ok {rc=0} 11:16:08.793478 --- ParallelTerminationStrategy: PID 12520 died... 11:16:08.812426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12520): Terminated: ok {rc=0} 11:16:08.899475 bus /sierra_3: Setting Powered False 11:16:09.999479 bus /sierra_3: Setting Powered False 11:16:11.112488 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 11:16:12.378407 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:16:12.383501 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:16:12.435691 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:16:12.462058 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:16:12.512623 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:16:12.563634 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:16:12.590059 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:16:13.142701 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 11:16:13.148261 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:16:13.159349 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 11:16:13.209361 tst handover.py: using LAC 40567 11:16:13.330454 tst handover.py: using RAC 22 11:16:13.457391 tst handover.py: using CellId 40567 11:16:13.577376 tst handover.py: using BVCI 40568 11:16:13.689546 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 11:16:13.722981 tst handover.py: using LAC 40568 11:16:13.841721 tst handover.py: using RAC 23 11:16:13.970471 tst handover.py: using CellId 40568 11:16:14.096479 tst handover.py: using BVCI 40569 11:16:14.209622 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:16:14.220691 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:16:14.235148 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:16:14.246629 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:16:14.258261 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:16:14.269534 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 11:16:14.386399 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 11:16:14.506929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:16:14.988034 run create_hlr_db(pid=12526): Launched 11:16:15.123737 bus /sierra_2: Setting Powered False 11:16:16.217711 run create_hlr_db(pid=12526): Terminated: ok {rc=0} 11:16:16.674640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12528): Launched 11:16:17.034291 run osmo-hlr_10.42.42.2(pid=12529): Launched 11:16:17.251345 run osmo-stp_10.42.42.5: Starting osmo-stp 11:16:17.781460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12531): Launched 11:16:18.088188 run osmo-stp_10.42.42.5(pid=12532): Launched 11:16:18.205664 run osmo-msc_10.42.42.6: Starting osmo-msc 11:16:18.735077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12534): Launched 11:16:19.045190 run osmo-msc_10.42.42.6(pid=12535): Launched 11:16:19.216564 run osmo-stp_10.42.42.5(pid=12532): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12532)] 11:16:19.344683 run osmo-stp_10.42.42.5(pid=12532): stdout: | (launched: 2022-12-14_11:16:18.031439) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:19.473857 run osmo-stp_10.42.42.5(pid=12532): stderr: | 20221214111618200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111618200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111618200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111618201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111618201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111618201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111618201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:19.601625 run osmo-stp_10.42.42.5(pid=12532): stdout: | (launched: 2022-12-14_11:16:18.031439) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:19.723720 run osmo-stp_10.42.42.5(pid=12532): stderr: | 20221214111618200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111618200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111618200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111618201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111618201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111618201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111618201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:19.869964 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12532): Process ended prematurely: osmo-stp_10.42.42.5(pid=12532) [trial-2403↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12532)] [trial-2403↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 11:16:19.878458 tst handover.py:18: Test FAILED (6.7 sec) 11:16:19.904607 run osmo-hlr_10.42.42.2(pid=12529): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12529)] 11:16:19.953150 run osmo-hlr_10.42.42.2(pid=12529): stdout: | (launched: 2022-12-14_11:16:16.957830) 11:16:20.003059 run osmo-hlr_10.42.42.2(pid=12529): stderr: | 20221214111617201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111617201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111617201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111617201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111617201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111617201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111617220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111617245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111617246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111617246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:16:20.072759 run osmo-msc_10.42.42.6(pid=12535): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12535)] 11:16:20.120309 run osmo-msc_10.42.42.6(pid=12535): stdout: | (launched: 2022-12-14_11:16:18.987921) 11:16:20.169913 run osmo-msc_10.42.42.6(pid=12535): stderr: | 20221214111619258 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111619258 DLGLOBAL DEBUG validating counter group 0x7faceea78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111619258 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111619258 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111619259 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111619259 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111619261 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111619261 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111619262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111619262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:16:20.220329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12528): Terminating (SIGTERM) 11:16:20.260138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12531): Terminating (SIGTERM) 11:16:20.300151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12534): Terminating (SIGTERM) 11:16:20.340514 --- ParallelTerminationStrategy: PID 12528 died... 11:16:20.360470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12528): Terminated: ok {rc=0} 11:16:20.405262 --- ParallelTerminationStrategy: PID 12531 died... 11:16:20.424421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12531): Terminated: ok {rc=0} 11:16:20.468857 --- ParallelTerminationStrategy: PID 12534 died... 11:16:20.488672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12534): Terminated: ok {rc=0} 11:16:20.575481 bus /sierra_3: Setting Powered False 11:16:21.675333 bus /sierra_3: Setting Powered False 11:16:22.788161 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 11:16:24.048802 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:16:24.054812 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:16:24.120702 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:16:24.148136 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:16:24.201522 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:16:24.269577 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:16:24.296730 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:16:24.841954 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 11:16:24.847575 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:16:24.859058 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:16:24.907499 tst handover.py: using LAC 40569 11:16:25.035736 tst handover.py: using RAC 24 11:16:25.164802 tst handover.py: using CellId 40569 11:16:25.293026 tst handover.py: using BVCI 40570 11:16:25.413917 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:16:25.463258 tst handover.py: using LAC 40570 11:16:25.584592 tst handover.py: using RAC 25 11:16:25.705359 tst handover.py: using CellId 40570 11:16:25.827214 tst handover.py: using BVCI 40571 11:16:25.939789 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:16:25.950779 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:16:25.961753 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:16:25.972543 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:16:25.983727 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:16:25.994863 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:16:26.114057 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:16:26.233535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:16:26.683719 run create_hlr_db(pid=12540): Launched 11:16:26.800496 bus /sierra_2: Setting Powered False 11:16:27.862669 run create_hlr_db(pid=12540): Terminated: ok {rc=0} 11:16:28.286486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12542): Launched 11:16:28.617331 run osmo-hlr_10.42.42.2(pid=12543): Launched 11:16:28.744054 run osmo-stp_10.42.42.5: Starting osmo-stp 11:16:29.285361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12545): Launched 11:16:29.616346 run osmo-stp_10.42.42.5(pid=12546): Launched 11:16:29.743144 run osmo-msc_10.42.42.6: Starting osmo-msc 11:16:30.310375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12548): Launched 11:16:30.639740 run osmo-msc_10.42.42.6(pid=12549): Launched 11:16:30.824197 run osmo-stp_10.42.42.5(pid=12546): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12546)] 11:16:31.090382 run osmo-stp_10.42.42.5(pid=12546): stdout: | (launched: 2022-12-14_11:16:29.555567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:31.443307 run osmo-stp_10.42.42.5(pid=12546): stderr: | 20221214111629746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111629746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111629746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111629746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111629747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111629747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111629747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:31.584010 run osmo-stp_10.42.42.5(pid=12546): stdout: | (launched: 2022-12-14_11:16:29.555567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:31.718791 run osmo-stp_10.42.42.5(pid=12546): stderr: | 20221214111629746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111629746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111629746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111629746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111629747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111629747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111629747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:31.880643 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12546): Process ended prematurely: osmo-stp_10.42.42.5(pid=12546) [trial-2403↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12546)] [trial-2403↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 11:16:31.891304 tst handover.py:18: Test FAILED (7.0 sec) 11:16:31.920421 run osmo-hlr_10.42.42.2(pid=12543): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12543)] 11:16:31.973582 run osmo-hlr_10.42.42.2(pid=12543): stdout: | (launched: 2022-12-14_11:16:28.556672) 11:16:32.027552 run osmo-hlr_10.42.42.2(pid=12543): stderr: | 20221214111628751 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111628751 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111628751 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111628751 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111628751 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111628751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111628762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111628771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111628771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111628771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:16:32.102178 run osmo-msc_10.42.42.6(pid=12549): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12549)] 11:16:32.154941 run osmo-msc_10.42.42.6(pid=12549): stdout: | (launched: 2022-12-14_11:16:30.578900) 11:16:32.208633 run osmo-msc_10.42.42.6(pid=12549): stderr: | 20221214111630983 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111630983 DLGLOBAL DEBUG validating counter group 0x7f43cbf18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111630983 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111630983 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111630983 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111630984 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111630990 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111630990 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111630991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111630991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:16:32.262801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12542): Terminating (SIGTERM) 11:16:32.305412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12545): Terminating (SIGTERM) 11:16:32.347038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12548): Terminating (SIGTERM) 11:16:32.388766 --- ParallelTerminationStrategy: PID 12542 died... 11:16:32.408647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12542): Terminated: ok {rc=0} 11:16:32.454815 --- ParallelTerminationStrategy: PID 12545 died... 11:16:32.474368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12545): Terminated: ok {rc=0} 11:16:32.520161 --- ParallelTerminationStrategy: PID 12548 died... 11:16:32.539818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12548): Terminated: ok {rc=0} 11:16:32.627334 bus /sierra_3: Setting Powered False 11:16:33.726369 bus /sierra_3: Setting Powered False 11:16:34.843612 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 11:16:36.120146 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:16:36.126289 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:16:36.190541 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:16:36.217951 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:16:36.272429 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:16:36.337786 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:16:36.365026 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:16:36.910663 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 11:16:36.915933 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:16:36.926938 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:16:36.975235 tst handover.py: using LAC 40571 11:16:37.104670 tst handover.py: using RAC 26 11:16:37.233203 tst handover.py: using CellId 40571 11:16:37.361931 tst handover.py: using BVCI 40572 11:16:37.481180 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:16:37.530361 tst handover.py: using LAC 40572 11:16:37.653107 tst handover.py: using RAC 27 11:16:37.782300 tst handover.py: using CellId 40572 11:16:37.910836 tst handover.py: using BVCI 40573 11:16:38.029703 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:16:38.041368 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:16:38.052763 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:16:38.064592 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:16:38.075948 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:16:38.087217 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:16:38.206372 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:16:38.326475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:16:38.776921 run create_hlr_db(pid=12554): Launched 11:16:38.894909 bus /sierra_2: Setting Powered False 11:16:39.955807 run create_hlr_db(pid=12554): Terminated: ok {rc=0} 11:16:40.378594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12556): Launched 11:16:40.709573 run osmo-hlr_10.42.42.2(pid=12557): Launched 11:16:40.836455 run osmo-stp_10.42.42.5: Starting osmo-stp 11:16:41.373368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12559): Launched 11:16:41.703646 run osmo-stp_10.42.42.5(pid=12560): Launched 11:16:41.830248 run osmo-msc_10.42.42.6: Starting osmo-msc 11:16:42.394430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12562): Launched 11:16:42.722490 run osmo-msc_10.42.42.6(pid=12563): Launched 11:16:42.907035 run osmo-stp_10.42.42.5(pid=12560): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12560)] 11:16:43.044535 run osmo-stp_10.42.42.5(pid=12560): stdout: | (launched: 2022-12-14_11:16:41.642991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:43.184804 run osmo-stp_10.42.42.5(pid=12560): stderr: | 20221214111641832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111641832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111641832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111641833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111641833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111641833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111641834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:43.321513 run osmo-stp_10.42.42.5(pid=12560): stdout: | (launched: 2022-12-14_11:16:41.642991) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:43.451456 run osmo-stp_10.42.42.5(pid=12560): stderr: | 20221214111641832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111641832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111641832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111641833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111641833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111641833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111641834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:43.606927 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12560): Process ended prematurely: osmo-stp_10.42.42.5(pid=12560) [trial-2403↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12560)] [trial-2403↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 11:16:43.616075 tst handover.py:18: Test FAILED (6.7 sec) 11:16:43.643853 run osmo-hlr_10.42.42.2(pid=12557): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12557)] 11:16:43.693856 run osmo-hlr_10.42.42.2(pid=12557): stdout: | (launched: 2022-12-14_11:16:40.649090) 11:16:43.745551 run osmo-hlr_10.42.42.2(pid=12557): stderr: | 20221214111640842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111640842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111640842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111640842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111640843 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111640843 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111640855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111640863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111640864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111640864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:16:43.817588 run osmo-msc_10.42.42.6(pid=12563): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12563)] 11:16:43.867153 run osmo-msc_10.42.42.6(pid=12563): stdout: | (launched: 2022-12-14_11:16:42.662021) 11:16:43.918950 run osmo-msc_10.42.42.6(pid=12563): stderr: | 20221214111642981 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111642981 DLGLOBAL DEBUG validating counter group 0x7f1ad9414c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111642982 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111642982 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111642982 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111642982 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111642984 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111642985 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111642985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111642985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:16:43.971153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12556): Terminating (SIGTERM) 11:16:44.012909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12559): Terminating (SIGTERM) 11:16:44.055251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12562): Terminating (SIGTERM) 11:16:44.097265 --- ParallelTerminationStrategy: PID 12556 died... 11:16:44.117887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12556): Terminated: ok {rc=0} 11:16:44.164194 --- ParallelTerminationStrategy: PID 12559 died... 11:16:44.184044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12559): Terminated: ok {rc=0} 11:16:44.229995 --- ParallelTerminationStrategy: PID 12562 died... 11:16:44.249654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12562): Terminated: ok {rc=0} 11:16:44.336514 bus /sierra_3: Setting Powered False 11:16:45.436012 bus /sierra_3: Setting Powered False 11:16:46.559289 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 11:16:47.850551 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:16:47.856317 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:16:47.908086 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:16:47.935188 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:16:47.989627 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:16:48.041323 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:16:48.068477 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:16:48.617180 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 11:16:48.623156 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:16:48.634504 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:16:48.668342 tst handover.py: using LAC 40573 11:16:48.797393 tst handover.py: using RAC 28 11:16:48.926552 tst handover.py: using CellId 40573 11:16:49.055669 tst handover.py: using BVCI 40574 11:16:49.175195 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:16:49.227408 tst handover.py: using LAC 40574 11:16:49.349181 tst handover.py: using RAC 29 11:16:49.467962 tst handover.py: using CellId 40574 11:16:49.586810 tst handover.py: using BVCI 40575 11:16:49.698183 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:16:49.708929 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:16:49.719607 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:16:49.730253 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:16:49.741695 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:16:49.753237 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:16:49.875522 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:16:49.992680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:16:50.440885 run create_hlr_db(pid=12568): Launched 11:16:50.557925 bus /sierra_2: Setting Powered False 11:16:51.619851 run create_hlr_db(pid=12568): Terminated: ok {rc=0} 11:16:52.024002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12570): Launched 11:16:52.332238 run osmo-hlr_10.42.42.2(pid=12571): Launched 11:16:52.449440 run osmo-stp_10.42.42.5: Starting osmo-stp 11:16:52.964852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12573): Launched 11:16:53.273217 run osmo-stp_10.42.42.5(pid=12574): Launched 11:16:53.391213 run osmo-msc_10.42.42.6: Starting osmo-msc 11:16:53.922011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12576): Launched 11:16:54.233334 run osmo-msc_10.42.42.6(pid=12577): Launched 11:16:54.405931 run osmo-stp_10.42.42.5(pid=12574): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12574)] 11:16:54.536158 run osmo-stp_10.42.42.5(pid=12574): stdout: | (launched: 2022-12-14_11:16:53.216084) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:54.666213 run osmo-stp_10.42.42.5(pid=12574): stderr: | 20221214111653384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111653384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111653385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111653385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111653386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111653386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111653386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:54.794353 run osmo-stp_10.42.42.5(pid=12574): stdout: | (launched: 2022-12-14_11:16:53.216084) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:16:54.916722 run osmo-stp_10.42.42.5(pid=12574): stderr: | 20221214111653384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111653384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111653385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111653385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111653386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111653386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111653386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:16:55.063155 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12574): Process ended prematurely: osmo-stp_10.42.42.5(pid=12574) [trial-2403↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12574)] [trial-2403↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 11:16:55.071651 tst handover.py:18: Test FAILED (6.4 sec) 11:16:55.098045 run osmo-hlr_10.42.42.2(pid=12571): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12571)] 11:16:55.146845 run osmo-hlr_10.42.42.2(pid=12571): stdout: | (launched: 2022-12-14_11:16:52.275594) 11:16:55.197228 run osmo-hlr_10.42.42.2(pid=12571): stderr: | 20221214111652450 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111652450 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111652450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111652450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111652450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111652450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111652462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111652470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111652470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111652470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:16:55.267857 run osmo-msc_10.42.42.6(pid=12577): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12577)] 11:16:55.315788 run osmo-msc_10.42.42.6(pid=12577): stdout: | (launched: 2022-12-14_11:16:54.176090) 11:16:55.365985 run osmo-msc_10.42.42.6(pid=12577): stderr: | 20221214111654444 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111654444 DLGLOBAL DEBUG validating counter group 0x7fb15a8c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111654444 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111654444 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111654444 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111654445 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111654446 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111654447 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111654447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111654447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:16:55.416442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12570): Terminating (SIGTERM) 11:16:55.457032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12573): Terminating (SIGTERM) 11:16:55.497584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12576): Terminating (SIGTERM) 11:16:55.538719 --- ParallelTerminationStrategy: PID 12570 died... 11:16:55.558561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12570): Terminated: ok {rc=0} 11:16:55.603167 --- ParallelTerminationStrategy: PID 12573 died... 11:16:55.622150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12573): Terminated: ok {rc=0} 11:16:55.666403 --- ParallelTerminationStrategy: PID 12576 died... 11:16:55.685400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12576): Terminated: ok {rc=0} 11:16:55.769962 bus /sierra_3: Setting Powered False 11:16:56.869924 bus /sierra_3: Setting Powered False 11:16:57.987330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 11:16:59.241109 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:16:59.246444 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:16:59.296834 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:16:59.323175 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:16:59.376674 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:16:59.428824 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:16:59.456939 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:17:00.004319 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 11:17:00.009898 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:17:00.021150 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:17:00.059671 tst handover.py: using LAC 40575 11:17:00.188244 tst handover.py: using RAC 30 11:17:00.315316 tst handover.py: using CellId 40575 11:17:00.442031 tst handover.py: using BVCI 40576 11:17:00.561268 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:17:00.608404 tst handover.py: using LAC 40576 11:17:00.737178 tst handover.py: using RAC 31 11:17:00.877044 tst handover.py: using CellId 40576 11:17:01.013433 tst handover.py: using BVCI 40577 11:17:01.143835 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:17:01.155638 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:17:01.167319 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:17:01.179121 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:17:01.191005 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:17:01.202745 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:17:01.346952 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:17:01.475608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:17:01.940108 run create_hlr_db(pid=12585): Launched 11:17:02.096214 bus /sierra_2: Setting Powered False 11:17:03.158092 run create_hlr_db(pid=12585): Terminated: ok {rc=0} 11:17:03.581278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12587): Launched 11:17:03.910956 run osmo-hlr_10.42.42.2(pid=12588): Launched 11:17:04.037573 run osmo-stp_10.42.42.5: Starting osmo-stp 11:17:04.579272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12590): Launched 11:17:04.909890 run osmo-stp_10.42.42.5(pid=12591): Launched 11:17:05.036753 run osmo-msc_10.42.42.6: Starting osmo-msc 11:17:05.603292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12593): Launched 11:17:05.931996 run osmo-msc_10.42.42.6(pid=12594): Launched 11:17:06.115776 run osmo-stp_10.42.42.5(pid=12591): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12591)] 11:17:06.253578 run osmo-stp_10.42.42.5(pid=12591): stdout: | (launched: 2022-12-14_11:17:04.849420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:06.391622 run osmo-stp_10.42.42.5(pid=12591): stderr: | 20221214111705040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111705040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111705041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111705041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111705041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111705041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111705042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:06.527825 run osmo-stp_10.42.42.5(pid=12591): stdout: | (launched: 2022-12-14_11:17:04.849420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:06.657577 run osmo-stp_10.42.42.5(pid=12591): stderr: | 20221214111705040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111705040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111705041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111705041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111705041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111705041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111705042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:06.813232 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12591): Process ended prematurely: osmo-stp_10.42.42.5(pid=12591) [trial-2403↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12591)] [trial-2403↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 11:17:06.822362 tst handover.py:18: Test FAILED (6.8 sec) 11:17:06.850125 run osmo-hlr_10.42.42.2(pid=12588): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12588)] 11:17:06.900581 run osmo-hlr_10.42.42.2(pid=12588): stdout: | (launched: 2022-12-14_11:17:03.850908) 11:17:06.952554 run osmo-hlr_10.42.42.2(pid=12588): stderr: | 20221214111704046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111704046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111704046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111704046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111704046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111704046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111704059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111704069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111704069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111704069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:17:07.025496 run osmo-msc_10.42.42.6(pid=12594): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12594)] 11:17:07.075572 run osmo-msc_10.42.42.6(pid=12594): stdout: | (launched: 2022-12-14_11:17:05.871500) 11:17:07.127975 run osmo-msc_10.42.42.6(pid=12594): stderr: | 20221214111706191 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111706191 DLGLOBAL DEBUG validating counter group 0x7f8bb8cc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111706191 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111706191 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111706191 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111706191 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111706193 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111706194 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111706194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111706194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:17:07.180372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12587): Terminating (SIGTERM) 11:17:07.222615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12590): Terminating (SIGTERM) 11:17:07.264746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12593): Terminating (SIGTERM) 11:17:07.307107 --- ParallelTerminationStrategy: PID 12587 died... 11:17:07.327526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12587): Terminated: ok {rc=0} 11:17:07.374262 --- ParallelTerminationStrategy: PID 12590 died... 11:17:07.394022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12590): Terminated: ok {rc=0} 11:17:07.440460 --- ParallelTerminationStrategy: PID 12593 died... 11:17:07.460323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12593): Terminated: ok {rc=0} 11:17:07.548703 bus /sierra_3: Setting Powered False 11:17:08.646018 bus /sierra_3: Setting Powered False 11:17:09.763506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2403 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 11:17:11.021091 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:17:11.026724 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:17:11.090097 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:17:11.117393 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:17:11.172702 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:17:11.235101 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:17:11.261461 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:17:11.815838 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2403 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 11:17:11.821440 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:17:11.835292 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:17:11.883450 tst handover.py: using LAC 40577 11:17:12.003625 tst handover.py: using RAC 32 11:17:12.122307 tst handover.py: using CellId 40577 11:17:12.256307 tst handover.py: using BVCI 40578 11:17:12.376656 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:17:12.423572 tst handover.py: using LAC 40578 11:17:12.551579 tst handover.py: using RAC 33 11:17:12.679956 tst handover.py: using CellId 40578 11:17:12.810925 tst handover.py: using BVCI 40579 11:17:12.931485 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:17:12.942817 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:17:12.954151 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:17:12.965417 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:17:12.976455 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:17:12.987662 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:17:13.109080 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:17:13.230348 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:17:13.681690 run create_hlr_db(pid=12599): Launched 11:17:13.799818 bus /sierra_2: Setting Powered False 11:17:14.860552 run create_hlr_db(pid=12599): Terminated: ok {rc=0} 11:17:15.265060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12601): Launched 11:17:15.573245 run osmo-hlr_10.42.42.2(pid=12602): Launched 11:17:15.690571 run osmo-stp_10.42.42.5: Starting osmo-stp 11:17:16.210917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12604): Launched 11:17:16.536579 run osmo-stp_10.42.42.5(pid=12605): Launched 11:17:16.770655 run osmo-msc_10.42.42.6: Starting osmo-msc 11:17:17.531034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12607): Launched 11:17:17.841431 run osmo-msc_10.42.42.6(pid=12608): Launched 11:17:18.013107 run osmo-stp_10.42.42.5(pid=12605): ERR: Terminated: ERROR {rc=1} [trial-2403↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12605)] 11:17:18.143075 run osmo-stp_10.42.42.5(pid=12605): stdout: | (launched: 2022-12-14_11:17:16.479660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:18.273634 run osmo-stp_10.42.42.5(pid=12605): stderr: | 20221214111716830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111716830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111716830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111716830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111716831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111716831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111716831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:18.401891 run osmo-stp_10.42.42.5(pid=12605): stdout: | (launched: 2022-12-14_11:17:16.479660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:17:18.523833 run osmo-stp_10.42.42.5(pid=12605): stderr: | 20221214111716830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214111716830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214111716830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214111716830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214111716831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214111716831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214111716831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:17:18.669761 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=12605): Process ended prematurely: osmo-stp_10.42.42.5(pid=12605) [trial-2403↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12605)] [trial-2403↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 11:17:18.677995 tst handover.py:18: Test FAILED (6.9 sec) 11:17:18.704255 run osmo-hlr_10.42.42.2(pid=12602): ERR: Terminated: ERROR {rc=237} [trial-2403↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12602)] 11:17:18.753290 run osmo-hlr_10.42.42.2(pid=12602): stdout: | (launched: 2022-12-14_11:17:15.516326) 11:17:18.803452 run osmo-hlr_10.42.42.2(pid=12602): stderr: | 20221214111715689 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214111715689 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214111715689 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214111715689 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214111715690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214111715690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214111715702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214111715710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214111715710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214111715710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:17:18.873775 run osmo-msc_10.42.42.6(pid=12608): ERR: Terminated: ERROR {rc=2} [trial-2403↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12608)] 11:17:18.921945 run osmo-msc_10.42.42.6(pid=12608): stdout: | (launched: 2022-12-14_11:17:17.784307) 11:17:18.972010 run osmo-msc_10.42.42.6(pid=12608): stderr: | 20221214111718054 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214111718054 DLGLOBAL DEBUG validating counter group 0x7f7e44850c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214111718054 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214111718054 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214111718055 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214111718055 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214111718057 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214111718057 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214111718057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214111718057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:17:19.022643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12601): Terminating (SIGTERM) 11:17:19.063152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12604): Terminating (SIGTERM) 11:17:19.104075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12607): Terminating (SIGTERM) 11:17:19.145272 --- ParallelTerminationStrategy: PID 12601 died... 11:17:19.164882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12601): Terminated: ok {rc=0} 11:17:19.209341 --- ParallelTerminationStrategy: PID 12604 died... 11:17:19.228304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12604): Terminated: ok {rc=0} 11:17:19.272720 --- ParallelTerminationStrategy: PID 12607 died... 11:17:19.291839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12607): Terminated: ok {rc=0} 11:17:19.378910 bus /sierra_3: Setting Powered False 11:17:20.479923 bus /sierra_3: Setting Powered False 11:17:21.597061 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2403 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 11:17:22.869908 tst trial-2403: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403/run.2022-12-14_09-52-37/trial-2403.xml -------------------------------------------------------------------------------------------- trial-2403 FAIL -------------------------------------------------------------------------------------------- 11:17:24.819466 tst trial-2403: trial-2403: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.0 sec) Error: osmo-nitb_10.42.42.2(pid=3372): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3372) [trial-2403↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3372)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.1 sec) Error: osmo-stp_10.42.42.5(pid=3392): Process ended prematurely: osmo-stp_10.42.42.5(pid=3392) [trial-2403↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3392)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=3754): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3754) [trial-2403↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3754)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3881): Process ended prematurely: osmo-stp_10.42.42.5(pid=3881) [trial-2403↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3881)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3955): Process ended prematurely: osmo-stp_10.42.42.5(pid=3955) [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3955)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3966): Process ended prematurely: osmo-stp_10.42.42.5(pid=3966) [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3966)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3982): Process ended prematurely: osmo-stp_10.42.42.5(pid=3982) [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3982)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3993): Process ended prematurely: osmo-stp_10.42.42.5(pid=3993) [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3993)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4007): Process ended prematurely: osmo-stp_10.42.42.5(pid=4007) [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4007)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4019): Process ended prematurely: osmo-stp_10.42.42.5(pid=4019) [trial-2403↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4019)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4033): Process ended prematurely: osmo-stp_10.42.42.5(pid=4033) [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4033)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4044): Process ended prematurely: osmo-stp_10.42.42.5(pid=4044) [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4044)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4058): Process ended prematurely: osmo-stp_10.42.42.5(pid=4058) [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4058)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4069): Process ended prematurely: osmo-stp_10.42.42.5(pid=4069) [trial-2403↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4069)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4083): Process ended prematurely: osmo-stp_10.42.42.5(pid=4083) [trial-2403↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4083)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4095): Process ended prematurely: osmo-stp_10.42.42.5(pid=4095) [trial-2403↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4095)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4109): Process ended prematurely: osmo-stp_10.42.42.5(pid=4109) [trial-2403↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4109)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4120): Process ended prematurely: osmo-stp_10.42.42.5(pid=4120) [trial-2403↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4120)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4134): Process ended prematurely: osmo-stp_10.42.42.5(pid=4134) [trial-2403↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4134)] FAIL: emergency_preemptive_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=4145): Process ended prematurely: osmo-stp_10.42.42.5(pid=4145) [trial-2403↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4145)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.6 sec) Error: osmo-stp_10.42.42.5(pid=4163): Process ended prematurely: osmo-stp_10.42.42.5(pid=4163) [trial-2403↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4163)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=4175): Process ended prematurely: osmo-stp_10.42.42.5(pid=4175) [trial-2403↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4175)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=4193): Process ended prematurely: osmo-stp_10.42.42.5(pid=4193) [trial-2403↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4193)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=4203): Process ended prematurely: osmo-stp_10.42.42.5(pid=4203) [trial-2403↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4203)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4213): Process ended prematurely: osmo-stp_10.42.42.5(pid=4213) [trial-2403↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4213)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=4233): Process ended prematurely: osmo-stp_10.42.42.5(pid=4233) [trial-2403↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4233)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=4245): Process ended prematurely: osmo-stp_10.42.42.5(pid=4245) [trial-2403↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4245)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=4263): Process ended prematurely: osmo-stp_10.42.42.5(pid=4263) [trial-2403↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4263)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=4276): Process ended prematurely: osmo-stp_10.42.42.5(pid=4276) [trial-2403↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4276)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4286): Process ended prematurely: osmo-stp_10.42.42.5(pid=4286) [trial-2403↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4286)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=4303): Process ended prematurely: osmo-stp_10.42.42.5(pid=4303) [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4303)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=4315): Process ended prematurely: osmo-stp_10.42.42.5(pid=4315) [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4315)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=4335): Process ended prematurely: osmo-stp_10.42.42.5(pid=4335) [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4335)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4345): Process ended prematurely: osmo-stp_10.42.42.5(pid=4345) [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4345)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4355): Process ended prematurely: osmo-stp_10.42.42.5(pid=4355) [trial-2403↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4355)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=4373): Process ended prematurely: osmo-stp_10.42.42.5(pid=4373) [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4373)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=4385): Process ended prematurely: osmo-stp_10.42.42.5(pid=4385) [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4385)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=4403): Process ended prematurely: osmo-stp_10.42.42.5(pid=4403) [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4403)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4414): Process ended prematurely: osmo-stp_10.42.42.5(pid=4414) [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4414)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4424): Process ended prematurely: osmo-stp_10.42.42.5(pid=4424) [trial-2403↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4424)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4437): Process ended prematurely: osmo-stp_10.42.42.5(pid=4437) [trial-2403↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4437)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4451): Process ended prematurely: osmo-stp_10.42.42.5(pid=4451) [trial-2403↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4451)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=4460): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4460) [trial-2403↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4460)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=4471): Process ended prematurely: osmo-stp_10.42.42.5(pid=4471) [trial-2403↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4471)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=4480): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4480) [trial-2403↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4480)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=4490): Process ended prematurely: osmo-stp_10.42.42.5(pid=4490) [trial-2403↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4490)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4504): Process ended prematurely: osmo-stp_10.42.42.5(pid=4504) [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4504)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4515): Process ended prematurely: osmo-stp_10.42.42.5(pid=4515) [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4515)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4529): Process ended prematurely: osmo-stp_10.42.42.5(pid=4529) [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4529)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4540): Process ended prematurely: osmo-stp_10.42.42.5(pid=4540) [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4540)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4554): Process ended prematurely: osmo-stp_10.42.42.5(pid=4554) [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4554)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4565): Process ended prematurely: osmo-stp_10.42.42.5(pid=4565) [trial-2403↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4565)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4579): Process ended prematurely: osmo-stp_10.42.42.5(pid=4579) [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4579)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4590): Process ended prematurely: osmo-stp_10.42.42.5(pid=4590) [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4590)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4604): Process ended prematurely: osmo-stp_10.42.42.5(pid=4604) [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4604)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4625): Process ended prematurely: osmo-stp_10.42.42.5(pid=4625) [trial-2403↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4625)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4991): Process ended prematurely: osmo-stp_10.42.42.5(pid=4991) [trial-2403↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4991)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5178): Process ended prematurely: osmo-stp_10.42.42.5(pid=5178) [trial-2403↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5178)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5192): Process ended prematurely: osmo-stp_10.42.42.5(pid=5192) [trial-2403↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5192)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5204): Process ended prematurely: osmo-stp_10.42.42.5(pid=5204) [trial-2403↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5204)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5219): Process ended prematurely: osmo-stp_10.42.42.5(pid=5219) [trial-2403↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5219)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5230): Process ended prematurely: osmo-stp_10.42.42.5(pid=5230) [trial-2403↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5230)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=5248): Process ended prematurely: osmo-stp_10.42.42.5(pid=5248) [trial-2403↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5248)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=5260): Process ended prematurely: osmo-stp_10.42.42.5(pid=5260) [trial-2403↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5260)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=5278): Process ended prematurely: osmo-stp_10.42.42.5(pid=5278) [trial-2403↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5278)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5289): Process ended prematurely: osmo-stp_10.42.42.5(pid=5289) [trial-2403↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5289)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5299): Process ended prematurely: osmo-stp_10.42.42.5(pid=5299) [trial-2403↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5299)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=5317): Process ended prematurely: osmo-stp_10.42.42.5(pid=5317) [trial-2403↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5317)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=5329): Process ended prematurely: osmo-stp_10.42.42.5(pid=5329) [trial-2403↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5329)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=5348): Process ended prematurely: osmo-stp_10.42.42.5(pid=5348) [trial-2403↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5348)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5358): Process ended prematurely: osmo-stp_10.42.42.5(pid=5358) [trial-2403↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5358)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5368): Process ended prematurely: osmo-stp_10.42.42.5(pid=5368) [trial-2403↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5368)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=5386): Process ended prematurely: osmo-stp_10.42.42.5(pid=5386) [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5386)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=5398): Process ended prematurely: osmo-stp_10.42.42.5(pid=5398) [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5398)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=5416): Process ended prematurely: osmo-stp_10.42.42.5(pid=5416) [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5416)] FAIL: ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=5698): Process ended prematurely: osmo-stp_10.42.42.5(pid=5698) [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5698)] FAIL: ping_idle_ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=5708): Process ended prematurely: osmo-stp_10.42.42.5(pid=5708) [trial-2403↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5708)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=5726): Process ended prematurely: osmo-stp_10.42.42.5(pid=5726) [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5726)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=5738): Process ended prematurely: osmo-stp_10.42.42.5(pid=5738) [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5738)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=5756): Process ended prematurely: osmo-stp_10.42.42.5(pid=5756) [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5756)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5823): Process ended prematurely: osmo-stp_10.42.42.5(pid=5823) [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5823)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6139): Process ended prematurely: osmo-stp_10.42.42.5(pid=6139) [trial-2403↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6139)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6328): Process ended prematurely: osmo-stp_10.42.42.5(pid=6328) [trial-2403↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6328)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6343): Process ended prematurely: osmo-stp_10.42.42.5(pid=6343) [trial-2403↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6343)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=6351): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6351) [trial-2403↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6351)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6361): Process ended prematurely: osmo-stp_10.42.42.5(pid=6361) [trial-2403↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6361)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=6370): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6370) [trial-2403↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6370)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6380): Process ended prematurely: osmo-stp_10.42.42.5(pid=6380) [trial-2403↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6380)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6394): Process ended prematurely: osmo-stp_10.42.42.5(pid=6394) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6394)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6405): Process ended prematurely: osmo-stp_10.42.42.5(pid=6405) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6405)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6420): Process ended prematurely: osmo-stp_10.42.42.5(pid=6420) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6420)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6431): Process ended prematurely: osmo-stp_10.42.42.5(pid=6431) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6431)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6445): Process ended prematurely: osmo-stp_10.42.42.5(pid=6445) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6445)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6456): Process ended prematurely: osmo-stp_10.42.42.5(pid=6456) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6456)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6471): Process ended prematurely: osmo-stp_10.42.42.5(pid=6471) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6471)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6482): Process ended prematurely: osmo-stp_10.42.42.5(pid=6482) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6482)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6496): Process ended prematurely: osmo-stp_10.42.42.5(pid=6496) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6496)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6507): Process ended prematurely: osmo-stp_10.42.42.5(pid=6507) [trial-2403↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6507)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6521): Process ended prematurely: osmo-stp_10.42.42.5(pid=6521) [trial-2403↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6521)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6532): Process ended prematurely: osmo-stp_10.42.42.5(pid=6532) [trial-2403↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6532)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6546): Process ended prematurely: osmo-stp_10.42.42.5(pid=6546) [trial-2403↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6546)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6557): Process ended prematurely: osmo-stp_10.42.42.5(pid=6557) [trial-2403↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6557)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6572): Process ended prematurely: osmo-stp_10.42.42.5(pid=6572) [trial-2403↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6572)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6583): Process ended prematurely: osmo-stp_10.42.42.5(pid=6583) [trial-2403↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6583)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6597): Process ended prematurely: osmo-stp_10.42.42.5(pid=6597) [trial-2403↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6597)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6609): Process ended prematurely: osmo-stp_10.42.42.5(pid=6609) [trial-2403↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6609)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=6623): Process ended prematurely: osmo-stp_10.42.42.5(pid=6623) [trial-2403↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6623)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6634): Process ended prematurely: osmo-stp_10.42.42.5(pid=6634) [trial-2403↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6634)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=6663): Process ended prematurely: osmo-stp_10.42.42.5(pid=6663) [trial-2403↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6663)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=7026): Process ended prematurely: osmo-stp_10.42.42.5(pid=7026) [trial-2403↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7026)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=7220): Process ended prematurely: osmo-stp_10.42.42.5(pid=7220) [trial-2403↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7220)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7230): Process ended prematurely: osmo-stp_10.42.42.5(pid=7230) [trial-2403↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7230)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7240): Process ended prematurely: osmo-stp_10.42.42.5(pid=7240) [trial-2403↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7240)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7257): Process ended prematurely: osmo-stp_10.42.42.5(pid=7257) [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7257)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=7269): Process ended prematurely: osmo-stp_10.42.42.5(pid=7269) [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7269)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=7287): Process ended prematurely: osmo-stp_10.42.42.5(pid=7287) [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7287)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7297): Process ended prematurely: osmo-stp_10.42.42.5(pid=7297) [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7297)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7307): Process ended prematurely: osmo-stp_10.42.42.5(pid=7307) [trial-2403↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7307)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7327): Process ended prematurely: osmo-stp_10.42.42.5(pid=7327) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7327)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=7339): Process ended prematurely: osmo-stp_10.42.42.5(pid=7339) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7339)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=7357): Process ended prematurely: osmo-stp_10.42.42.5(pid=7357) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7357)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7367): Process ended prematurely: osmo-stp_10.42.42.5(pid=7367) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7367)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7377): Process ended prematurely: osmo-stp_10.42.42.5(pid=7377) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7377)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7397): Process ended prematurely: osmo-stp_10.42.42.5(pid=7397) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7397)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7409): Process ended prematurely: osmo-stp_10.42.42.5(pid=7409) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7409)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7427): Process ended prematurely: osmo-stp_10.42.42.5(pid=7427) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7427)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7437): Process ended prematurely: osmo-stp_10.42.42.5(pid=7437) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7437)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7447): Process ended prematurely: osmo-stp_10.42.42.5(pid=7447) [trial-2403↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7447)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7464): Process ended prematurely: osmo-stp_10.42.42.5(pid=7464) [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7464)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=7477): Process ended prematurely: osmo-stp_10.42.42.5(pid=7477) [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7477)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=7497): Process ended prematurely: osmo-stp_10.42.42.5(pid=7497) [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7497)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7507): Process ended prematurely: osmo-stp_10.42.42.5(pid=7507) [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7507)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7517): Process ended prematurely: osmo-stp_10.42.42.5(pid=7517) [trial-2403↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7517)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7534): Process ended prematurely: osmo-stp_10.42.42.5(pid=7534) [trial-2403↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7534)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7547): Process ended prematurely: osmo-stp_10.42.42.5(pid=7547) [trial-2403↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7547)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=7555): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7555) [trial-2403↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7555)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=7565): Process ended prematurely: osmo-stp_10.42.42.5(pid=7565) [trial-2403↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7565)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=7575): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7575) [trial-2403↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7575)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=7587): Process ended prematurely: osmo-stp_10.42.42.5(pid=7587) [trial-2403↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7587)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7601): Process ended prematurely: osmo-stp_10.42.42.5(pid=7601) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7601)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7612): Process ended prematurely: osmo-stp_10.42.42.5(pid=7612) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7612)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7626): Process ended prematurely: osmo-stp_10.42.42.5(pid=7626) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7626)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7637): Process ended prematurely: osmo-stp_10.42.42.5(pid=7637) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7637)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7651): Process ended prematurely: osmo-stp_10.42.42.5(pid=7651) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7651)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7662): Process ended prematurely: osmo-stp_10.42.42.5(pid=7662) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7662)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7678): Process ended prematurely: osmo-stp_10.42.42.5(pid=7678) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7678)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7689): Process ended prematurely: osmo-stp_10.42.42.5(pid=7689) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7689)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7703): Process ended prematurely: osmo-stp_10.42.42.5(pid=7703) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7703)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7714): Process ended prematurely: osmo-stp_10.42.42.5(pid=7714) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7714)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7728): Process ended prematurely: osmo-stp_10.42.42.5(pid=7728) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7728)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7739): Process ended prematurely: osmo-stp_10.42.42.5(pid=7739) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7739)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7753): Process ended prematurely: osmo-stp_10.42.42.5(pid=7753) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7753)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7764): Process ended prematurely: osmo-stp_10.42.42.5(pid=7764) [trial-2403↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7764)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7778): Process ended prematurely: osmo-stp_10.42.42.5(pid=7778) [trial-2403↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7778)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7789): Process ended prematurely: osmo-stp_10.42.42.5(pid=7789) [trial-2403↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7789)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=7808): Process ended prematurely: osmo-stp_10.42.42.5(pid=7808) [trial-2403↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7808)] FAIL: iperf3.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=8092): Process ended prematurely: osmo-stp_10.42.42.5(pid=8092) [trial-2403↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8092)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=8110): Process ended prematurely: osmo-stp_10.42.42.5(pid=8110) [trial-2403↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8110)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8120): Process ended prematurely: osmo-stp_10.42.42.5(pid=8120) [trial-2403↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8120)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8131): Process ended prematurely: osmo-stp_10.42.42.5(pid=8131) [trial-2403↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8131)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=8151): Process ended prematurely: osmo-stp_10.42.42.5(pid=8151) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8151)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=8163): Process ended prematurely: osmo-stp_10.42.42.5(pid=8163) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8163)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=8181): Process ended prematurely: osmo-stp_10.42.42.5(pid=8181) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8181)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8192): Process ended prematurely: osmo-stp_10.42.42.5(pid=8192) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8192)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8202): Process ended prematurely: osmo-stp_10.42.42.5(pid=8202) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8202)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=8223): Process ended prematurely: osmo-stp_10.42.42.5(pid=8223) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8223)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=8235): Process ended prematurely: osmo-stp_10.42.42.5(pid=8235) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8235)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=8253): Process ended prematurely: osmo-stp_10.42.42.5(pid=8253) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8253)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8263): Process ended prematurely: osmo-stp_10.42.42.5(pid=8263) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8263)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8273): Process ended prematurely: osmo-stp_10.42.42.5(pid=8273) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8273)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=8290): Process ended prematurely: osmo-stp_10.42.42.5(pid=8290) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8290)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=8304): Process ended prematurely: osmo-stp_10.42.42.5(pid=8304) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8304)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=8322): Process ended prematurely: osmo-stp_10.42.42.5(pid=8322) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8322)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8332): Process ended prematurely: osmo-stp_10.42.42.5(pid=8332) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8332)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8342): Process ended prematurely: osmo-stp_10.42.42.5(pid=8342) [trial-2403↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8342)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8355): Process ended prematurely: osmo-stp_10.42.42.5(pid=8355) [trial-2403↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8355)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8369): Process ended prematurely: osmo-stp_10.42.42.5(pid=8369) [trial-2403↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8369)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=8378): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8378) [trial-2403↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8378)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8388): Process ended prematurely: osmo-stp_10.42.42.5(pid=8388) [trial-2403↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8388)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=8397): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8397) [trial-2403↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8397)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8407): Process ended prematurely: osmo-stp_10.42.42.5(pid=8407) [trial-2403↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8407)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8421): Process ended prematurely: osmo-stp_10.42.42.5(pid=8421) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8421)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8432): Process ended prematurely: osmo-stp_10.42.42.5(pid=8432) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8432)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8446): Process ended prematurely: osmo-stp_10.42.42.5(pid=8446) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8446)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8457): Process ended prematurely: osmo-stp_10.42.42.5(pid=8457) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8457)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8471): Process ended prematurely: osmo-stp_10.42.42.5(pid=8471) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8471)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8482): Process ended prematurely: osmo-stp_10.42.42.5(pid=8482) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8482)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8500): Process ended prematurely: osmo-stp_10.42.42.5(pid=8500) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8500)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8511): Process ended prematurely: osmo-stp_10.42.42.5(pid=8511) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8511)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8527): Process ended prematurely: osmo-stp_10.42.42.5(pid=8527) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8527)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8538): Process ended prematurely: osmo-stp_10.42.42.5(pid=8538) [trial-2403↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8538)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8552): Process ended prematurely: osmo-stp_10.42.42.5(pid=8552) [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8552)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8564): Process ended prematurely: osmo-stp_10.42.42.5(pid=8564) [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8564)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8578): Process ended prematurely: osmo-stp_10.42.42.5(pid=8578) [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8578)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8589): Process ended prematurely: osmo-stp_10.42.42.5(pid=8589) [trial-2403↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8589)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8603): Process ended prematurely: osmo-stp_10.42.42.5(pid=8603) [trial-2403↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8603)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8614): Process ended prematurely: osmo-stp_10.42.42.5(pid=8614) [trial-2403↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8614)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8628): Process ended prematurely: osmo-stp_10.42.42.5(pid=8628) [trial-2403↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8628)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8639): Process ended prematurely: osmo-stp_10.42.42.5(pid=8639) [trial-2403↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8639)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=8658): Process ended prematurely: osmo-stp_10.42.42.5(pid=8658) [trial-2403↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8658)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=8670): Process ended prematurely: osmo-stp_10.42.42.5(pid=8670) [trial-2403↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8670)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=8689): Process ended prematurely: osmo-stp_10.42.42.5(pid=8689) [trial-2403↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8689)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8699): Process ended prematurely: osmo-stp_10.42.42.5(pid=8699) [trial-2403↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8699)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8710): Process ended prematurely: osmo-stp_10.42.42.5(pid=8710) [trial-2403↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8710)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=8727): Process ended prematurely: osmo-stp_10.42.42.5(pid=8727) [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8727)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8739): Process ended prematurely: osmo-stp_10.42.42.5(pid=8739) [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8739)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8757): Process ended prematurely: osmo-stp_10.42.42.5(pid=8757) [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8757)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8767): Process ended prematurely: osmo-stp_10.42.42.5(pid=8767) [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8767)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8778): Process ended prematurely: osmo-stp_10.42.42.5(pid=8778) [trial-2403↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8778)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=8795): Process ended prematurely: osmo-stp_10.42.42.5(pid=8795) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8795)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=8807): Process ended prematurely: osmo-stp_10.42.42.5(pid=8807) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8807)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=8825): Process ended prematurely: osmo-stp_10.42.42.5(pid=8825) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8825)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8835): Process ended prematurely: osmo-stp_10.42.42.5(pid=8835) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8835)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8849): Process ended prematurely: osmo-stp_10.42.42.5(pid=8849) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8849)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=8867): Process ended prematurely: osmo-stp_10.42.42.5(pid=8867) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8867)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=8879): Process ended prematurely: osmo-stp_10.42.42.5(pid=8879) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8879)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8897): Process ended prematurely: osmo-stp_10.42.42.5(pid=8897) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8897)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8907): Process ended prematurely: osmo-stp_10.42.42.5(pid=8907) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8907)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8917): Process ended prematurely: osmo-stp_10.42.42.5(pid=8917) [trial-2403↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8917)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=8935): Process ended prematurely: osmo-stp_10.42.42.5(pid=8935) [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8935)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=8947): Process ended prematurely: osmo-stp_10.42.42.5(pid=8947) [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8947)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=8965): Process ended prematurely: osmo-stp_10.42.42.5(pid=8965) [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8965)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8975): Process ended prematurely: osmo-stp_10.42.42.5(pid=8975) [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8975)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8985): Process ended prematurely: osmo-stp_10.42.42.5(pid=8985) [trial-2403↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8985)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8999): Process ended prematurely: osmo-stp_10.42.42.5(pid=8999) [trial-2403↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8999)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9012): Process ended prematurely: osmo-stp_10.42.42.5(pid=9012) [trial-2403↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9012)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9020): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9020) [trial-2403↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9020)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9030): Process ended prematurely: osmo-stp_10.42.42.5(pid=9030) [trial-2403↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9030)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=9039): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9039) [trial-2403↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9039)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9049): Process ended prematurely: osmo-stp_10.42.42.5(pid=9049) [trial-2403↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9049)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9063): Process ended prematurely: osmo-stp_10.42.42.5(pid=9063) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9063)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9074): Process ended prematurely: osmo-stp_10.42.42.5(pid=9074) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9074)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9088): Process ended prematurely: osmo-stp_10.42.42.5(pid=9088) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9088)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9099): Process ended prematurely: osmo-stp_10.42.42.5(pid=9099) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9099)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9113): Process ended prematurely: osmo-stp_10.42.42.5(pid=9113) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9113)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9394): Process ended prematurely: osmo-stp_10.42.42.5(pid=9394) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9394)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9411): Process ended prematurely: osmo-stp_10.42.42.5(pid=9411) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9411)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9422): Process ended prematurely: osmo-stp_10.42.42.5(pid=9422) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9422)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9437): Process ended prematurely: osmo-stp_10.42.42.5(pid=9437) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9437)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9448): Process ended prematurely: osmo-stp_10.42.42.5(pid=9448) [trial-2403↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9448)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9465): Process ended prematurely: osmo-stp_10.42.42.5(pid=9465) [trial-2403↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9465)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9476): Process ended prematurely: osmo-stp_10.42.42.5(pid=9476) [trial-2403↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9476)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9491): Process ended prematurely: osmo-stp_10.42.42.5(pid=9491) [trial-2403↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9491)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9502): Process ended prematurely: osmo-stp_10.42.42.5(pid=9502) [trial-2403↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9502)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9517): Process ended prematurely: osmo-stp_10.42.42.5(pid=9517) [trial-2403↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9517)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9530): Process ended prematurely: osmo-stp_10.42.42.5(pid=9530) [trial-2403↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9530)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=9548): Process ended prematurely: osmo-stp_10.42.42.5(pid=9548) [trial-2403↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9548)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9560): Process ended prematurely: osmo-stp_10.42.42.5(pid=9560) [trial-2403↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9560)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=9578): Process ended prematurely: osmo-stp_10.42.42.5(pid=9578) [trial-2403↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9578)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9588): Process ended prematurely: osmo-stp_10.42.42.5(pid=9588) [trial-2403↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9588)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=9602): Process ended prematurely: osmo-stp_10.42.42.5(pid=9602) [trial-2403↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9602)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=9619): Process ended prematurely: osmo-stp_10.42.42.5(pid=9619) [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9619)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=9631): Process ended prematurely: osmo-stp_10.42.42.5(pid=9631) [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9631)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=9649): Process ended prematurely: osmo-stp_10.42.42.5(pid=9649) [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9649)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9659): Process ended prematurely: osmo-stp_10.42.42.5(pid=9659) [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9659)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9669): Process ended prematurely: osmo-stp_10.42.42.5(pid=9669) [trial-2403↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9669)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=9686): Process ended prematurely: osmo-stp_10.42.42.5(pid=9686) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9686)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=9698): Process ended prematurely: osmo-stp_10.42.42.5(pid=9698) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9698)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=9716): Process ended prematurely: osmo-stp_10.42.42.5(pid=9716) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9716)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9726): Process ended prematurely: osmo-stp_10.42.42.5(pid=9726) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9726)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9736): Process ended prematurely: osmo-stp_10.42.42.5(pid=9736) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9736)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=9756): Process ended prematurely: osmo-stp_10.42.42.5(pid=9756) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9756)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=9768): Process ended prematurely: osmo-stp_10.42.42.5(pid=9768) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9768)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=9786): Process ended prematurely: osmo-stp_10.42.42.5(pid=9786) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9786)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9796): Process ended prematurely: osmo-stp_10.42.42.5(pid=9796) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9796)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=9809): Process ended prematurely: osmo-stp_10.42.42.5(pid=9809) [trial-2403↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9809)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9823): Process ended prematurely: osmo-stp_10.42.42.5(pid=9823) [trial-2403↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9823)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9836): Process ended prematurely: osmo-stp_10.42.42.5(pid=9836) [trial-2403↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9836)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9845): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9845) [trial-2403↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9845)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9855): Process ended prematurely: osmo-stp_10.42.42.5(pid=9855) [trial-2403↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9855)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=9864): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9864) [trial-2403↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9864)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=9875): Process ended prematurely: osmo-stp_10.42.42.5(pid=9875) [trial-2403↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9875)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9889): Process ended prematurely: osmo-stp_10.42.42.5(pid=9889) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9889)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9900): Process ended prematurely: osmo-stp_10.42.42.5(pid=9900) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9900)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9914): Process ended prematurely: osmo-stp_10.42.42.5(pid=9914) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9914)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9925): Process ended prematurely: osmo-stp_10.42.42.5(pid=9925) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9925)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9939): Process ended prematurely: osmo-stp_10.42.42.5(pid=9939) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9939)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9950): Process ended prematurely: osmo-stp_10.42.42.5(pid=9950) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9950)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9964): Process ended prematurely: osmo-stp_10.42.42.5(pid=9964) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9964)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9975): Process ended prematurely: osmo-stp_10.42.42.5(pid=9975) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9975)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9989): Process ended prematurely: osmo-stp_10.42.42.5(pid=9989) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9989)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10000): Process ended prematurely: osmo-stp_10.42.42.5(pid=10000) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10000)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10014): Process ended prematurely: osmo-stp_10.42.42.5(pid=10014) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10014)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10025): Process ended prematurely: osmo-stp_10.42.42.5(pid=10025) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10025)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10039): Process ended prematurely: osmo-stp_10.42.42.5(pid=10039) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10039)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10050): Process ended prematurely: osmo-stp_10.42.42.5(pid=10050) [trial-2403↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10050)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10067): Process ended prematurely: osmo-stp_10.42.42.5(pid=10067) [trial-2403↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10067)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10078): Process ended prematurely: osmo-stp_10.42.42.5(pid=10078) [trial-2403↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10078)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10096): Process ended prematurely: osmo-stp_10.42.42.5(pid=10096) [trial-2403↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10096)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10108): Process ended prematurely: osmo-stp_10.42.42.5(pid=10108) [trial-2403↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10108)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=10126): Process ended prematurely: osmo-stp_10.42.42.5(pid=10126) [trial-2403↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10126)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10136): Process ended prematurely: osmo-stp_10.42.42.5(pid=10136) [trial-2403↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10136)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10146): Process ended prematurely: osmo-stp_10.42.42.5(pid=10146) [trial-2403↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10146)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10167): Process ended prematurely: osmo-stp_10.42.42.5(pid=10167) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10167)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10179): Process ended prematurely: osmo-stp_10.42.42.5(pid=10179) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10179)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=10197): Process ended prematurely: osmo-stp_10.42.42.5(pid=10197) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10197)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10208): Process ended prematurely: osmo-stp_10.42.42.5(pid=10208) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10208)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10220): Process ended prematurely: osmo-stp_10.42.42.5(pid=10220) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10220)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10237): Process ended prematurely: osmo-stp_10.42.42.5(pid=10237) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10237)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10249): Process ended prematurely: osmo-stp_10.42.42.5(pid=10249) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10249)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=10267): Process ended prematurely: osmo-stp_10.42.42.5(pid=10267) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10267)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10277): Process ended prematurely: osmo-stp_10.42.42.5(pid=10277) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10277)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10287): Process ended prematurely: osmo-stp_10.42.42.5(pid=10287) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10287)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=10305): Process ended prematurely: osmo-stp_10.42.42.5(pid=10305) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10305)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10317): Process ended prematurely: osmo-stp_10.42.42.5(pid=10317) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10317)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=10335): Process ended prematurely: osmo-stp_10.42.42.5(pid=10335) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10335)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10345): Process ended prematurely: osmo-stp_10.42.42.5(pid=10345) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10345)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10355): Process ended prematurely: osmo-stp_10.42.42.5(pid=10355) [trial-2403↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10355)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10369): Process ended prematurely: osmo-stp_10.42.42.5(pid=10369) [trial-2403↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10369)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10382): Process ended prematurely: osmo-stp_10.42.42.5(pid=10382) [trial-2403↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10382)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=10390): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10390) [trial-2403↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10390)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10400): Process ended prematurely: osmo-stp_10.42.42.5(pid=10400) [trial-2403↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10400)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=10409): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10409) [trial-2403↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10409)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10419): Process ended prematurely: osmo-stp_10.42.42.5(pid=10419) [trial-2403↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10419)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=10433): Process ended prematurely: osmo-stp_10.42.42.5(pid=10433) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10433)] FAIL: mo_mt_call_osmux.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=10717): Process ended prematurely: osmo-stp_10.42.42.5(pid=10717) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10717)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10732): Process ended prematurely: osmo-stp_10.42.42.5(pid=10732) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10732)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10743): Process ended prematurely: osmo-stp_10.42.42.5(pid=10743) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10743)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10757): Process ended prematurely: osmo-stp_10.42.42.5(pid=10757) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10757)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10768): Process ended prematurely: osmo-stp_10.42.42.5(pid=10768) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10768)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10785): Process ended prematurely: osmo-stp_10.42.42.5(pid=10785) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10785)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10796): Process ended prematurely: osmo-stp_10.42.42.5(pid=10796) [trial-2403↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10796)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10810): Process ended prematurely: osmo-stp_10.42.42.5(pid=10810) [trial-2403↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10810)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10821): Process ended prematurely: osmo-stp_10.42.42.5(pid=10821) [trial-2403↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10821)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10835): Process ended prematurely: osmo-stp_10.42.42.5(pid=10835) [trial-2403↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10835)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10849): Process ended prematurely: osmo-stp_10.42.42.5(pid=10849) [trial-2403↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10849)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=10867): Process ended prematurely: osmo-stp_10.42.42.5(pid=10867) [trial-2403↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10867)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=10879): Process ended prematurely: osmo-stp_10.42.42.5(pid=10879) [trial-2403↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10879)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=10897): Process ended prematurely: osmo-stp_10.42.42.5(pid=10897) [trial-2403↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10897)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10919): Process ended prematurely: osmo-stp_10.42.42.5(pid=10919) [trial-2403↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10919)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10929): Process ended prematurely: osmo-stp_10.42.42.5(pid=10929) [trial-2403↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10929)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=10946): Process ended prematurely: osmo-stp_10.42.42.5(pid=10946) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10946)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10958): Process ended prematurely: osmo-stp_10.42.42.5(pid=10958) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10958)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=10976): Process ended prematurely: osmo-stp_10.42.42.5(pid=10976) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10976)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10986): Process ended prematurely: osmo-stp_10.42.42.5(pid=10986) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10986)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10996): Process ended prematurely: osmo-stp_10.42.42.5(pid=10996) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10996)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11018): Process ended prematurely: osmo-stp_10.42.42.5(pid=11018) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11018)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=11030): Process ended prematurely: osmo-stp_10.42.42.5(pid=11030) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11030)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=11048): Process ended prematurely: osmo-stp_10.42.42.5(pid=11048) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11048)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=11058): Process ended prematurely: osmo-stp_10.42.42.5(pid=11058) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11058)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11068): Process ended prematurely: osmo-stp_10.42.42.5(pid=11068) [trial-2403↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11068)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11081): Process ended prematurely: osmo-stp_10.42.42.5(pid=11081) [trial-2403↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11081)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11094): Process ended prematurely: osmo-stp_10.42.42.5(pid=11094) [trial-2403↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11094)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=11103): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11103) [trial-2403↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11103)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11114): Process ended prematurely: osmo-stp_10.42.42.5(pid=11114) [trial-2403↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11114)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11128): Process ended prematurely: osmo-stp_10.42.42.5(pid=11128) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11128)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11142): Process ended prematurely: osmo-stp_10.42.42.5(pid=11142) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11142)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11156): Process ended prematurely: osmo-stp_10.42.42.5(pid=11156) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11156)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11167): Process ended prematurely: osmo-stp_10.42.42.5(pid=11167) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11167)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11181): Process ended prematurely: osmo-stp_10.42.42.5(pid=11181) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11181)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11192): Process ended prematurely: osmo-stp_10.42.42.5(pid=11192) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11192)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11208): Process ended prematurely: osmo-stp_10.42.42.5(pid=11208) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11208)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11221): Process ended prematurely: osmo-stp_10.42.42.5(pid=11221) [trial-2403↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11221)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11235): Process ended prematurely: osmo-stp_10.42.42.5(pid=11235) [trial-2403↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11235)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11246): Process ended prematurely: osmo-stp_10.42.42.5(pid=11246) [trial-2403↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11246)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11260): Process ended prematurely: osmo-stp_10.42.42.5(pid=11260) [trial-2403↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11260)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11271): Process ended prematurely: osmo-stp_10.42.42.5(pid=11271) [trial-2403↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11271)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11285): Process ended prematurely: osmo-stp_10.42.42.5(pid=11285) [trial-2403↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11285)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11296): Process ended prematurely: osmo-stp_10.42.42.5(pid=11296) [trial-2403↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11296)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=11314): Process ended prematurely: osmo-stp_10.42.42.5(pid=11314) [trial-2403↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11314)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=11326): Process ended prematurely: osmo-stp_10.42.42.5(pid=11326) [trial-2403↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11326)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=11344): Process ended prematurely: osmo-stp_10.42.42.5(pid=11344) [trial-2403↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11344)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11355): Process ended prematurely: osmo-stp_10.42.42.5(pid=11355) [trial-2403↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11355)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11365): Process ended prematurely: osmo-stp_10.42.42.5(pid=11365) [trial-2403↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11365)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11382): Process ended prematurely: osmo-stp_10.42.42.5(pid=11382) [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11382)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=11394): Process ended prematurely: osmo-stp_10.42.42.5(pid=11394) [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11394)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=11412): Process ended prematurely: osmo-stp_10.42.42.5(pid=11412) [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11412)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=11422): Process ended prematurely: osmo-stp_10.42.42.5(pid=11422) [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11422)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11432): Process ended prematurely: osmo-stp_10.42.42.5(pid=11432) [trial-2403↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11432)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=11451): Process ended prematurely: osmo-stp_10.42.42.5(pid=11451) [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11451)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=11463): Process ended prematurely: osmo-stp_10.42.42.5(pid=11463) [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11463)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=11482): Process ended prematurely: osmo-stp_10.42.42.5(pid=11482) [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11482)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11495): Process ended prematurely: osmo-stp_10.42.42.5(pid=11495) [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11495)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11505): Process ended prematurely: osmo-stp_10.42.42.5(pid=11505) [trial-2403↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11505)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=11522): Process ended prematurely: osmo-stp_10.42.42.5(pid=11522) [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11522)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=11534): Process ended prematurely: osmo-stp_10.42.42.5(pid=11534) [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11534)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=11555): Process ended prematurely: osmo-stp_10.42.42.5(pid=11555) [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11555)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11565): Process ended prematurely: osmo-stp_10.42.42.5(pid=11565) [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11565)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11575): Process ended prematurely: osmo-stp_10.42.42.5(pid=11575) [trial-2403↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11575)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11588): Process ended prematurely: osmo-stp_10.42.42.5(pid=11588) [trial-2403↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11588)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=11596): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11596) [trial-2403↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11596)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=11598): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11598) [trial-2403↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11598)] FAIL: esme_ms_sms_storeforward.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=11600): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11600) [trial-2403↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11600)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=11602): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11602) [trial-2403↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11602)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.7 sec) Error: osmo-hlr_10.42.42.2(pid=11613): Process ended prematurely: osmo-hlr_10.42.42.2(pid=11613) [trial-2403↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11613)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=11624): Process ended prematurely: osmo-hlr_10.42.42.2(pid=11624) [trial-2403↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11624)] FAIL: esme_ms_sms_storeforward.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=11636): Process ended prematurely: osmo-stp_10.42.42.5(pid=11636) [trial-2403↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11636)] FAIL: esme_ms_sms_transaction.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11647): Process ended prematurely: osmo-stp_10.42.42.5(pid=11647) [trial-2403↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11647)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11661): Process ended prematurely: osmo-stp_10.42.42.5(pid=11661) [trial-2403↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11661)] FAIL: register_a5_0_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11672): Process ended prematurely: osmo-stp_10.42.42.5(pid=11672) [trial-2403↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11672)] FAIL: register_a5_1_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11683): Process ended prematurely: osmo-stp_10.42.42.5(pid=11683) [trial-2403↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11683)] FAIL: register_a5_3_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11694): Process ended prematurely: osmo-stp_10.42.42.5(pid=11694) [trial-2403↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11694)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.2 sec) Error: srsepc(pid=11714): Process ended prematurely: srsepc(pid=11714) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11714)] FAIL: iperf3_bidir.py (18.9 sec) Error: srsepc(pid=11730): Process ended prematurely: srsepc(pid=11730) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11730)] FAIL: iperf3_dl.py (18.8 sec) Error: srsepc(pid=11746): Process ended prematurely: srsepc(pid=11746) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=11746)] FAIL: iperf3_ul.py (20.2 sec) Error: srsepc(pid=12034): Process ended prematurely: srsepc(pid=12034) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=12034)] FAIL: ping.py (18.4 sec) Error: srsepc(pid=12051): Process ended prematurely: srsepc(pid=12051) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=12051)] FAIL: rrc_idle_mo_ping.py (18.2 sec) Error: srsepc(pid=12067): Process ended prematurely: srsepc(pid=12067) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=12067)] FAIL: rrc_idle_mt_ping.py (18.7 sec) Error: srsepc(pid=12087): Process ended prematurely: srsepc(pid=12087) [trial-2403↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=12087)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12102): Process ended prematurely: osmo-stp_10.42.42.5(pid=12102) [trial-2403↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12102)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12116): Process ended prematurely: osmo-stp_10.42.42.5(pid=12116) [trial-2403↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12116)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12130): Process ended prematurely: osmo-stp_10.42.42.5(pid=12130) [trial-2403↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12130)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12147): Process ended prematurely: osmo-stp_10.42.42.5(pid=12147) [trial-2403↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12147)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12161): Process ended prematurely: osmo-stp_10.42.42.5(pid=12161) [trial-2403↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12161)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12175): Process ended prematurely: osmo-stp_10.42.42.5(pid=12175) [trial-2403↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12175)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12190): Process ended prematurely: osmo-stp_10.42.42.5(pid=12190) [trial-2403↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12190)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12204): Process ended prematurely: osmo-stp_10.42.42.5(pid=12204) [trial-2403↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12204)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12218): Process ended prematurely: osmo-stp_10.42.42.5(pid=12218) [trial-2403↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12218)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12232): Process ended prematurely: osmo-stp_10.42.42.5(pid=12232) [trial-2403↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12232)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12246): Process ended prematurely: osmo-stp_10.42.42.5(pid=12246) [trial-2403↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12246)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12260): Process ended prematurely: osmo-stp_10.42.42.5(pid=12260) [trial-2403↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12260)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12274): Process ended prematurely: osmo-stp_10.42.42.5(pid=12274) [trial-2403↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12274)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12288): Process ended prematurely: osmo-stp_10.42.42.5(pid=12288) [trial-2403↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12288)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12302): Process ended prematurely: osmo-stp_10.42.42.5(pid=12302) [trial-2403↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12302)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12316): Process ended prematurely: osmo-stp_10.42.42.5(pid=12316) [trial-2403↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12316)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12330): Process ended prematurely: osmo-stp_10.42.42.5(pid=12330) [trial-2403↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12330)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12345): Process ended prematurely: osmo-stp_10.42.42.5(pid=12345) [trial-2403↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12345)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12359): Process ended prematurely: osmo-stp_10.42.42.5(pid=12359) [trial-2403↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12359)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12373): Process ended prematurely: osmo-stp_10.42.42.5(pid=12373) [trial-2403↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12373)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12387): Process ended prematurely: osmo-stp_10.42.42.5(pid=12387) [trial-2403↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12387)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12401): Process ended prematurely: osmo-stp_10.42.42.5(pid=12401) [trial-2403↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12401)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12415): Process ended prematurely: osmo-stp_10.42.42.5(pid=12415) [trial-2403↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12415)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12429): Process ended prematurely: osmo-stp_10.42.42.5(pid=12429) [trial-2403↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12429)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12447): Process ended prematurely: osmo-stp_10.42.42.5(pid=12447) [trial-2403↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12447)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12462): Process ended prematurely: osmo-stp_10.42.42.5(pid=12462) [trial-2403↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12462)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12476): Process ended prematurely: osmo-stp_10.42.42.5(pid=12476) [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12476)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12490): Process ended prematurely: osmo-stp_10.42.42.5(pid=12490) [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12490)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12504): Process ended prematurely: osmo-stp_10.42.42.5(pid=12504) [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12504)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12518): Process ended prematurely: osmo-stp_10.42.42.5(pid=12518) [trial-2403↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12518)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12532): Process ended prematurely: osmo-stp_10.42.42.5(pid=12532) [trial-2403↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12532)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=12546): Process ended prematurely: osmo-stp_10.42.42.5(pid=12546) [trial-2403↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12546)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12560): Process ended prematurely: osmo-stp_10.42.42.5(pid=12560) [trial-2403↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12560)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12574): Process ended prematurely: osmo-stp_10.42.42.5(pid=12574) [trial-2403↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12574)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12591): Process ended prematurely: osmo-stp_10.42.42.5(pid=12591) [trial-2403↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12591)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12605): Process ended prematurely: osmo-stp_10.42.42.5(pid=12605) [trial-2403↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12605)] + rm -rf trial-2403/inst + cd trial-2403 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-14 09:52:26 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403-run.tgz run.2022-12-14_09-52-37 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2403-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17689.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6695.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2998.tgz osmo-mgw.build-8965.tgz osmo-msc.build-29318.tgz osmo-nitb.build-12995.tgz osmo-pcu-oc2g.build-3913.tgz osmo-pcu-sysmo.build-5196.tgz osmo-pcu.build-5157.tgz osmo-sgsn.build-30105.tgz osmo-stp.build-9261.tgz osmo-trx.build-4686.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE